LLM failure on a simple question

A pilot friend posted on Facebook about his visit to the Sullenberger Aviation Museum, thus prompting me to celebrate Captain Sully’s heroism as the single pilot of an Airbus whose type certificate requires two pilots. He responded that it wouldn’t have been possible for the museum to be named after both Jeff Skiles, who did half of the flying on the flight that terminated in a water landing, and Sully. I turned to my spare brain, i.e., ChatGPT, to find counterexamples.

My prompt: “What are examples of museums named after two people with different last names?”

The giant brain’s answers, on different days:

I tried with a few other LLMs and the answers weren’t quite as useless, but they also included museums that plainly have just one last name in the name. Perplexity and Google’s AI summary (Gemini?) both offered the Nelson-Atkins Museum of Art as an example that fit my query, along with quite a few that didn’t. From the Google:

By giving ChatGPT an example (“the Kamala-Trump Museum of Cognitive Excellence”), I was able to improve the answer, but half of the results were museums that clearly violated my criteria:

It’s interesting, at least to me, how LLMs can be both so smart and so stupid.

4 thoughts on “LLM failure on a simple question

  1. Funny that it’s not in Danville, where Sullenberger was awarded the key to the city but couldn’t afford the house he was in. Like most righteous Calif*ahans, he was trying to fund his retirement with the house & get the hell out.

  2. I asked http://www.perplexity.ai the same question, got better answer (and its free, with no sign-up or email):

    – Nelson-Atkins Museum of Art: Located in Kansas City, Missouri, this museum is named after the philanthropist William Rockhill Nelson and the businessman and art collector, Thomas Hart Benton Atkins.

    – Museo Pio-Clementino: Located in the Vatican Museums, this museum is named after two popes: Clement XIV, who founded it, and Pius VI, who expanded it.

    – McCord Stewart Museum: This museum in Montreal, Canada, is named after its founder David Ross McCord and William D. Lighthall, who was instrumental in its establishment.

Leave a Reply

Your email address will not be published. Required fields are marked *