News for hackers. Stuff that matters.
Re:Hot take on OpenAI's new GPT-4o – by Gary Marcus by edmara on Wednesday May 15, 2024 @07:44AM (#40365598)
Gary Marcus was arguing in 2020 that scaling up GPT-2 wouldn't result in improvements in common sense or reasoning. He was wrong, and he continues to be wrong.

It's called the bitter lesson for a reason. Nobody likes seeing their life's work on some unicorn architecture get demolished by simplicity+scale

There are no comments on this comment yet.