News for hackers. Stuff that matters.

nielpen

Ask HN: Which of you used to be lurkers?

I've been following HN on-and-off for about two years, never posting or commenting anything. Recently I've been waking up to the value of writing for crystallizing my own thought, and trying to apply that learning.I'm curious, for those frequent posters / commenters here, how your engagement with this site changed once you started participating. Are you getting the same thing from HN that you...

( Read More... | 10 comments | 12 points | on HN )
Re:What's the Least Impressive Thing GPT-4 Won't Be Able to Do on Thursday December 08, 2022 @11:38AM (#33909900)
Oh 100% -- anthropomorphic bias towards AI is about to get really interesting, I'd expect. Especially if prompt engineering comes to be part of the job description for tech, which seems likely.
Re:What's the Least Impressive Thing GPT-4 Won't Be Able to Do on Thursday December 08, 2022 @11:09AM (#33909478)
Say "I don't know."

Back when GPT-3 was all the rage on the internet, I remember Kevin Lacker's "Giving GPT-3 a Turing Test" left a real impression on me [1]. Short read, but gets to the crux of the issue. GPT-3 is a (really sophisticated) statistical model, GPT-4 will be no different. Maybe it will showcase new emergent properties of LLMs, like GPT-3's in-prompt few-shot learning did. But the fundamental constraint of a statistical model optimized to a masking task remains -- they're really bad at introspection and confidence-assessment.

[1] https://lacker.io/ai/2020/07/06/giving-gpt-3-a-turing-test.h...