ChatGPT struggles to correct lecture slides
For this year’s FAA Ground School class at MIT I decided to let ChatGPT do all of the hard work of correcting and updating slides to account for any changes to regulations, etc. The LLM kicked out about five spurious suggestions for every useful typo correction. For example, here’s a slide about gliders whose title says that it is about gliders:
ChatGPT’s comment on the slide:
ChatGPT fails to use the title as context for the slide and, therefore, says that “solo at age 14” needs to be qualified to gliders only.
This slide points out the what the U.S. calls “light sport” is called “ultralight” in Europe:
ChatGPT:
It says to call the Shark a “light aircraft”, which typically refers to anything weighing less than 12,500 lbs. From the Shark manual, available on the Shark.aero web site:
Maybe ChatGPT doesn’t think that the Islamic Republic of Germany is part of “Europe” anymore?
ChatGPT is humorless. On the multi-engine/jet lecture:
“Now the second engine can take you to the scene of the accident!” ⚠️ Pedagogically funny, but borderline unsafe phrasing for students.
This ancient saying made ChatGPT feel unsafe. Its correction:
“Now the operating engine may or may not be able to maintain altitude, depending on weight, density altitude, and aircraft performance.”
On helicopter aerodynamics:
400 rpm actually is the Robinson R44 main rotor speed. The original slide gives the students a ballpark figure to keep in mind regarding how fast helicopter main rotors spin. ChatGPT’s “correction” leaves them guessing.
ChatGPT disagrees with the Robinson Factory Safety Course. It says “Rotor kinetic energy is the key stored energy” for landing without an operating engine. This can’t be right, intuitively, since it is possible to autorotate from 500′ and also from 5,000′.
ChatGPT when pressed stuck to its guns: “[altitude] is an external energy source”.
Summary: ChatGPT is better at creating slides than at correcting them.
Full post, including comments




























