News for hackers. Stuff that matters.
Re:Margaret Atwood Reviews a Margaret Atwood Story by AI by datameta on Sunday October 15, 2023 @09:48PM (#37895145)
My gut metric says it's a ~20% increase in perceived interpretation and output complexity, whatever that means exactly. But there are plenty of eval result aggregators out there.
Re:Margaret Atwood Reviews a Margaret Atwood Story by AI by muglug on Sunday October 15, 2023 @09:57PM (#37895192)
Yeah, there are measurable results on things like AP bio. And those are definitely not 10x.
Re:Margaret Atwood Reviews a Margaret Atwood Story by AI by mewpmewp2 on Monday October 16, 2023 @02:54AM (#37896577)
To me GPT-4 seems actually intelligent and reasoning capable while GPT-3.5 does not. Many of my usecases involve giving large bodies of text to GPT and asking to reason about this. 3.5 has no clue, but 4 seems to handle it intelligently.

Overall it is as if GPT3.5 feels just like a clueless summarizer, but GPT4 intelligent interpreter and reasoner that I can trust.

Depending on which way you look at it, it could be 10x or 1000x the intelligence.

Re:Margaret Atwood Reviews a Margaret Atwood Story by AI by datameta on Monday October 16, 2023 @03:12AM (#37896672)
I think trust is a key thing you've hightlighted. I find myself doubting GPT3.5, whereas not at all for GPT4.