News for hackers. Stuff that matters.
Re:LLMs are not greater than the sum of their parts: Stanfor... by jjeaff on Tuesday May 09, 2023 @01:19AM (#35870447)
Most voice assistants can work with simple phrases like that. Alexa, lights on. Hey Google, thermostat 70 degrees.
Re:LLMs are not greater than the sum of their parts: Stanfor... by gnicholas on Tuesday May 09, 2023 @01:44AM (#35870593)
Not Siri, which thinks I'm talking to her all the time when I'm speaking to a family member whose name contains neither an "s" nor an "r".
Re:LLMs are not greater than the sum of their parts: Stanfor... by hgsgm on Tuesday May 09, 2023 @08:46AM (#35873525)
That's because letters aren't sounds.
Re:LLMs are not greater than the sum of their parts: Stanfor... by gnicholas on Tuesday May 09, 2023 @10:36AM (#35874963)
Uh yeah, the name also doesn’t contain either sound.
Re:LLMs are not greater than the sum of their parts: Stanfor... by setr on Tuesday May 09, 2023 @11:37AM (#35876011)
The problem is that’s not the only format they work on, and because input format is largely unconstrained, when they misunderstand, they catastrophically misunderstand.

It’s just like the image recognition ML issue, where it can correctly predict a cat, but change a specific three pixels and it has 99% confidence it’s an ostrich.

Or JavaScript equality. If you do it right, it’s right, but otherwise anything goes.