News for hackers. Stuff that matters.
Re:Behind the curtain: what it feels like to work in AI righ... by kolinko on Friday April 07, 2023 @03:58AM (#35479296)
As for googling, here are some examples of queries you can try and see how it works:

- summary of all the carbon neutral concrete methods, especially ones that can be done in a small industrial workshop as a prototype

- I have allergies in Thailand, mid-february. What may it be related to?

- list all the companies from Japanese stock exchange that have high debt rate

Those are top of my head, but really anything that is either a super-specific niche, or requires merging a few niches together, Google won't help you with.

Re:Behind the curtain: what it feels like to work in AI righ... by lionkor on Friday April 07, 2023 @05:09AM (#35479724)
For all of those, you HAVE to be okay with a complete garbage answer. Are you?
Re:Behind the curtain: what it feels like to work in AI righ... by alexvoda on Friday April 07, 2023 @07:24AM (#35480472)
A machine generating confident bullshit will be the perfect companion for con-men to partially automate their workflow.

Humans are really gullible for the appearance of confidence. And humans are also very prone to wishful thinking.

Re:Behind the curtain: what it feels like to work in AI righ... by girvo on Friday April 07, 2023 @05:26AM (#35479809)
How do you deal with it straight up lying? My problem with this whole system is, if I’m asking those questions it’s because I don’t understand the field well enough to answer it myself, which means I can’t pick up on if ChatGPT is lying…
Re:Behind the curtain: what it feels like to work in AI righ... by SanderNL on Friday April 07, 2023 @10:38AM (#35482007)
Fair, but not completely true. The Thailand examples gives a detailed reasoning. You can use those building blocks to check. If it says Thailand is a cold country and uses that in its argumentation, it's shaky. You don't have to be an expert climatologist to make this judgement.

It's not just one clean answer and we're done. In my experience it is helpful in breaking the problem down into stuff you can Google.

Re:Behind the curtain: what it feels like to work in AI righ... by girvo on Friday April 07, 2023 @11:36PM (#35490277)
> In my experience it is helpful in breaking the problem down into stuff you can Google.

Yeah I can see that being useful. I’ve also seen a lot of non-technical people straight up accept whatever comes out of it, so that’s a little worrying. It’s true of Google searches too, of course, but at least a google search gives N results someone can check rather than 1.

Re:Behind the curtain: what it feels like to work in AI righ... by kolinko on Saturday April 08, 2023 @03:39AM (#35491392)
They straight up accept until they discover first mistakes :)
Re:Behind the curtain: what it feels like to work in AI righ... by kolinko on Saturday April 08, 2023 @03:38AM (#35491389)
Fact check with google.

With the example questions I provided, it would take many hours to do research on the subject. GPT provided initial answers instantly, and then fact checking was easy.

That’s what we did with gpt-3. With plugins you can have gpt fact-check itself.

Also, if you have a system for dedicated knowledge, you can use embeddings - with embeddings gpt has very little room for hallucinations, and it can provide detailed references.