90% of My Skills Are Now Worth $0

Re:90% of My Skills Are Now Worth $0 by jug on Wednesday April 19, 2023 @03:20PM (#35632178)

Yes, GPT 3.5 and less is particularly dangerous in this regard. I'd try this again against GPT-4 which should perform better. Essentially false information seems to go away _slowly_ with increased model sizes but then you hit the performance/hardware requirement barriers instead, and run into awkward token limits or high running costs.

ChatGPT thought hippos could swim when I asked but only GPT-4 realized they can't, but instead walk along the sea floor, or leap forward in deeper waters. That's a simple test for wrong inference since you'd _expect_ otherwise, given they spend so much time in water.

I wonder if we are truly "there" yet or if we at the very least need a more optimized "GPT-4 Turbo" for some real progress. Until then, we may hallucinate progress as much as the AI hallucinates answers!

[ Parent | on HN ]

Re:90% of My Skills Are Now Worth $0 by teekert on Wednesday April 19, 2023 @03:41PM (#35632412)

"since you'd _expect_ otherwise, given they spend so much time in water."

I think here it doesn't understand or conclude that hippos can swim because they are often in water, I think people wrote on the internet a lot that they can swim and it found some association between the terms hippo, water and swimming. Am I right?

[ Parent | on HN ]

Re:90% of My Skills Are Now Worth $0 by chrisco255 on Wednesday April 19, 2023 @04:24PM (#35632869)

Absolutely. It didn't infer anything. It just tried to predict how an educated human would respond to such a question, based on its corpus of knowledge.

[ Parent | on HN ]