News for hackers. Stuff that matters.
Re:GPT-4 by jimbokun on Tuesday March 14, 2023 @02:11PM (#35155910)
> bottom 10% to top 10% of LSAT in <1 generation? +100 pts on SAT reading, writing, math? Top 1% In GRE Reading?

People still really find it hard to internalize exponential improvement.

So many evaluations of LLMs were saying things like "Don't worry, your job is safe, it still can't do X and Y."

My immediate thought was always, "Yes, the current version can't, but what about a few weeks or months from now?"

Re:GPT-4 by snozolli on Tuesday March 14, 2023 @02:21PM (#35156115)
I'm also noticing a lot of comments that boil down to "but it's not smarter than the smartest human". What about the bottom 80% of society, in terms of intelligence or knowledge?
Re:GPT-4 by slingnow on Tuesday March 14, 2023 @02:24PM (#35156175)
> People still really find it hard to internalize exponential improvement.

I think people find it harder to not extrapolate initial exponential improvement, as evidenced by your comment.

> My immediate thought was always, "Yes, the current version can't, but what about a few weeks or months from now?"

This reasoning explains why every year, full self driving automobiles will be here "next year".

Re:GPT-4 by jimbokun on Tuesday March 14, 2023 @02:27PM (#35156243)
When do we hit the bend in the S-curve?

What's the fundamental limit where it becomes much more difficult to improve these systems without some new break through?

Re:GPT-4 by pbhjpbhj on Tuesday March 14, 2023 @02:59PM (#35156745)
When running them costs too much energy?
Re:GPT-4 by jimbokun on Tuesday March 14, 2023 @03:47PM (#35157301)
When should we expect to see that? Before they blow past humans in almost all tasks, or far past that point?