News for hackers. Stuff that matters.
Re:OpenAI, Google and Anthropic Are Struggling to Build More... by atomsatomsatoms on Thursday November 14, 2024 @01:01PM (#42139072)
At least they can generate haikus now
Re:OpenAI, Google and Anthropic Are Struggling to Build More... by Der_Einzige on Thursday November 14, 2024 @01:31PM (#42139466)
In general, no they can't:

https://gwern.net/gpt-3#bpes

https://paperswithcode.com/paper/most-language-models-can-be...

The appearance of improvements in that capability are due to the vocabulary of modern LLMs increasing. Still only putting lipstick on a pig.

Re:OpenAI, Google and Anthropic Are Struggling to Build More... by falcor84 on Thursday November 14, 2024 @01:52PM (#42139732)
I don't see how results from 2 years ago have any bearing on whether the models we have now can generate haikus (which from my experience, they absolutely can).

And if your "lipstick on a pig" argument is that even when they generate haikus, they aren't really writing haikus, then I'll link to this other gwern post, about how they'll never really be able to solve the rubik's cube - https://gwern.net/rubiks-cube