News for hackers. Stuff that matters.
Re:Google has sent internet into 'spiral of decline', claims... by Roark66 on Sunday October 15, 2023 @05:22AM (#37888271)
I use chatgpt for such things(and I'm working hard on getting an equivalent service quality from my local models as I hate the not-at-all-OpenAI, but they have the best model now). Then again I never know if the thing it says are true recipes or hallucinations. If you think about it, it's exactly like on the general Internet.
Re:Google has sent internet into 'spiral of decline', claims... by Too on Sunday October 15, 2023 @08:18AM (#37889136)
How well does that work? I would imagine recipes iate really hard to entrust to chatgpt. At least for baking, where ratios and timing is crucial. LLMs have very bad sense of numbers generally. How would you verify it’s not all bogus hallucinations? At best it’s a source of inspiration, for ingredients you can freestyle from yourself.
Re:Google has sent internet into 'spiral of decline', claims... by Roark66 on Sunday October 15, 2023 @09:43AM (#37889655)
I didn't mean recipes specifically, but this type of question where I'm looking for a very specific short answer. For example, I don't know if some software has some specific feature, or I ask, write me a short python script fragment that does this or that. Or how do I reverse a git commit that was pushed etc. Or what is the thermal conductivity of kingpin extreme paste. All are very specific things years ago I would use Google to search for, but today Google is almost useless on this.

It does hallucinate sometimes, it writes programs using non existent apis etc, but I've found asking it "is what you said correct" or "is it true?" or "how did you came up with this answer" tend to produce replies like : I'm sorry, this is wrong, this is good instead. On rare occasion it also produces a bad answer and when you ask it will alternate betetwo bad answers, but most of the time it does pretty well.

Here I tried asking it for a recipe for chocolate brownies. I also tried to find out if it gave correct answers. Based on my past use I'd say it's pretty likely the recipe is OK. What do you think? https://chat.openai.com/share/2b36e42c-b6f2-42f3-b67e-f4a5a7...

Re:Google has sent internet into 'spiral of decline', claims... by Too on Sunday October 15, 2023 @12:34PM (#37891156)
A programming snippet and a baking recipe are completely different. The first can be statically linted, fact checked against the docs, code reviewed and tested in a few seconds. Mainly it saves you the typing and finding the right name in the docs.

The later: a trip to the store, an hour of rising, then 1h in the oven, then all your guests arrive, not worth the gamble.

Re:Google has sent internet into 'spiral of decline', claims... by nullc on Sunday October 15, 2023 @10:59AM (#37890300)
The internet is full of false recipes that can't possibly work, probably increasingly LLM generated themselves. Consider: Persimmon jam. Not possible short of some secret chemical process-- heating reverses the chemical reaction that eliminates the astringency of the unripe persimmon. Yet there are now countless recipes online that will lead you to inedible muck, all effectively bogus hallucinations. Not necessarily machine ones, but also just content farms manually making every conceivable permutation of every existing recipe, the author of those persimmon jam recipes has probably never seen the fruit first hand.

At least if you LLM them on your own you know to be dubious and also you're more likely to use a 70B model (or GPT4) which is a little more likely to get them right, vs whatever garbage the spammer used.

It would probably be pretty interesting for someone to make a concerned effort to digitize every recipe in print prior to 2005 or so-- the relevant threshold time isn't when LLMs came on the scene but when google made low effort content farming so profitable.

It wasn't guaranteed that every recipe printed pre-internet had actually been cooked by anyone, but it was a lot more likely.

Re:Google has sent internet into 'spiral of decline', claims... by brucethemoose2 on Sunday October 15, 2023 @08:22AM (#37889159)
Yeah. LLMs+VectorDBs are great for many things, but when the information is not trivially verifiable (like with cooking), factual information retrieval is not one of them.