News for hackers. Stuff that matters.
Re:Ask HN: What is the weirdest or most surreal (recent) tec... by soperj on Tuesday January 24, 2023 @11:05AM (#34505372)
This is my exact problem with ChatGTP, it looks great when you don't know what it's talking about, but as soon as you do, it looks foolishly over-confident in it's answers which are very clearly wrong.
Re:Ask HN: What is the weirdest or most surreal (recent) tec... by krsw on Tuesday January 24, 2023 @11:37AM (#34505979)
Not much worse than a number of people I've talked with, to be honest.
Re:Ask HN: What is the weirdest or most surreal (recent) tec... by twic on Tuesday January 24, 2023 @12:47PM (#34507145)
Ha ha only serious - for me, the most profound thing about ChatGPT and friends is that they show how much of human behaviour is not actually intelligent in some deep sense.
Re:Ask HN: What is the weirdest or most surreal (recent) tec... by CamperBob2 on Tuesday January 24, 2023 @01:16PM (#34507573)
Exactly. It doesn't just share our abilities, it shares our flaws, which is actually more interesting and more disturbing.

It's not a crystal ball, it's a mirror.

Re:Ask HN: What is the weirdest or most surreal (recent) tec... by iliane5 on Tuesday January 24, 2023 @02:29PM (#34508853)
The fact that a "dumb", generative model that is simply predicting the next token when given a prompt can talk so well, perform complex tasks and interact with humans in such a convincing manner is pretty fascinating.

There is obviously more to human intelligence than text based conversation but it is pretty humbling that such an aspect of ourselves can be replicated and be so convincing at such an early stage and perform better than some humans even when it makes stuff up: toddlers can't talk, kids are smarter but don't have the technical knowledge, most adults only have a few specific areas of expertise, etc.

Re:Ask HN: What is the weirdest or most surreal (recent) tec... by Keyframe on Tuesday January 24, 2023 @11:14AM (#34505519)
which are very clearly wrong

but not always; And that's what makes it scary. You know people will use it and trusting it.

Re:Ask HN: What is the weirdest or most surreal (recent) tec... by jerry1979 on Tuesday January 24, 2023 @12:16PM (#34506653)
I believe the data gets trained by human rankers, and it should therefore regress to their mean. That said, if they train it to seek approval, I suppose we could teach it like any other student.
Re:Ask HN: What is the weirdest or most surreal (recent) tec... by anigbrowl on Tuesday January 24, 2023 @01:38PM (#34507964)
I don't like OpenAI's implementation defaults that much. But the thing is you can have a conversation with an LLM about bullshitting, explore the reasons why it's undesirable and inferior to sincere conversation, and then leverage those points of agreement to modify conversational behavior, at least within the scope of that conversation.
Re:Ask HN: What is the weirdest or most surreal (recent) tec... by yen223 on Tuesday January 24, 2023 @02:40PM (#34509039)
This is my main problem with HN, funnily enough.
Re:Ask HN: What is the weirdest or most surreal (recent) tec... by jredwards on Tuesday January 24, 2023 @05:03PM (#34511181)
As long as you're armed with that information, though, it makes getting to an 80% solution (to many things) almost effortless.