News for hackers. Stuff that matters.
Re:iPhone 15 and iPhone 15 Plus by sircastor on Tuesday September 12, 2023 @06:49PM (#37489675)
LLMs can't guarantee factuality. They're great for the conversational component, but they're a seriously bad and responding with reliably factual information. More important that its ability to deal with complexity would be an assistant's ability to respond to a request correctly.
Re:iPhone 15 and iPhone 15 Plus by anonporridge on Tuesday September 12, 2023 @07:14PM (#37489945)
Nothing and no one can guarantee factuality. That's a red herring.
Re:iPhone 15 and iPhone 15 Plus by sircastor on Tuesday September 12, 2023 @08:27PM (#37490584)
That's abusing a turn-of-phrase to provide a counter-argument. Of course no one can guarantee universal factuality. But relative to information we're seeking from an assistant (schedules, email data, messages, music preferences) it is very easy to obtain highly accurate data. But LLMs don't work like that.

The conceptual model behind LLMs utilizes frequency to generate a reasonable response to a query. But that's a bad fit when you're looking for data accuracy that isn't represented by the model. If your model says most dental appointments occur on the 15th and responds so but my appointment is on the 17th, it's not only useless to me it's detrimental.