Will Silicon Valley executives ever accept this reality? If we acquiesce and admit that LLMs are a good tool for prototyping and boilerplate-reduction, but not finished products-- is that when the bubble finally bursts?
I used to feel job safety in the knowledge that AI labs weren't likely to solve the hallucination problem. Then it dawned on me that they don't need to — they just need to reduce our collective expectations.
We've never had to act with surgical precision except in matters of math/science/engineering.
Like how you fill up your coffee cup up to a level probably +/- 50ml each morning.
When you fill up your coffee cup in the morning, I sure hope you aim accurately and don't pour half of it all over your desk. And don't even get me started on the process of making coffee that isn't completely unpalatable.
I attempted to explore the works of Kinoko Nasu/TYPE-MOON through its characters and the relationships across works and it was mostly nonsense. Sure it had some broad relations correct, but it presented a tiny set of meaningful characters and only attempted to touch Fate/Stay-Night and Tsukihime.
Even more damning was that it produced garbled text for a few of the textual representations and often even if the lettering was clean, the grammar was off.
Went to the website, typed in "Jeep Wrangler JK engine bay with components labeled" (Since I'm intimately familiar with JK engine bays). Seems like a pretty analogous test to what you did, if anything an even easier test.
Let's see what we get .. a very nice looking diagram of a wrangler engine bay with components labeled, looks good.
But wait ..
- The brake fluid reservoir is on the wrong side of the engine bay
- Where the brake fluid reservoir is, it's labeled as the coolant overflow tank, and while the actual coolant overflow tank does exist in the diagram, it has no label.
- The battery is on the wrong side of the engine bay.
- The top of the front grill is labeled as the "oil filter cap".
- The oil fill cap is in the wrong place.
- Half of the battery is labeled as the fuse box, when the fuse box is correctly shown, but unlabeled, on the other side of the engine bay.
- It shows two different windshield washer reservoirs next to each other.
I could keep going on ...
Now I tried clicking on the incorrectly labeled coolant overflow reservoir and it switches to a new page which now shows a completely different looking coolant overflow, but now it's at least located in the correct place in the engine bay.
But of course it doesn't look remotely like the actual coolant overflow container. It also shows the radiator cap as on the top of the coolant reservoir, when in reality it is very much on the top of the radiator itself.
Like .. I can find fault with every aspect of it. But of course, if you didn't actually know much about the topic it'd all look fairly believable. The story of LLMs basically.