News for hackers. Stuff that matters.
Re:Behind the curtain: what it feels like to work in AI righ... by teaearlgraycold on Friday April 07, 2023 @03:03AM (#35478947)
For me it’s a perfect replacement for Stack Overflow. Except every solution is tailored to my exact code and situation. I’ve even gotten it to walk me through things like installing WSL 2 without using the Microsoft Store after I nuked all Appx packages.

Maybe my favorite was pasting in pages of documentation describing all of the error codes for a library (the docs are the only source of truth) and getting it to output a very good typescript enum.

Re:Behind the curtain: what it feels like to work in AI righ... by csmpltn on Friday April 07, 2023 @03:24AM (#35479067)
You don't need a full-blown LLM to find answers to questions on StackOverflow. You can do that today with any search engine.

> "I’ve even gotten it to walk me through things like installing WSL 2 without using the Microsoft Store after I nuked all Appx packages."

That's a search engine query you can issue already today, without involving any LLMs. It will cost a fraction of the cost of running this with an LLM, and it'll actually bring you to the "source" of the information (a thread on StackOverflow with the full context - including "wrong answers" which are just as useful) - unlike an LLM.

Re:Behind the curtain: what it feels like to work in AI righ... by FranzFerdiNaN on Friday April 07, 2023 @03:40AM (#35479168)
The problem with SO is asking questions though. It’s a horrible site for that purpose. I rather get a slightly wrong answer from ChatGPT than the insane experience of trying to formulate my question just right so it won’t get closed or deleted on SO.
Re:Behind the curtain: what it feels like to work in AI righ... by greeny7373 on Friday April 07, 2023 @04:15AM (#35479420)
And?

I can also use a horse to ride to my parents and im still using a car?!

Re:Behind the curtain: what it feels like to work in AI righ... by csmpltn on Friday April 07, 2023 @04:58AM (#35479664)
Sure, you can keep throwing those hyped VC/MBA-style retorts all around, or you can acknowledge the simple reality that when it comes to the task of finding answers to questions on SO, traditional search technology outperforms LLMs on every parameter:

1. Cost: it's much easier to build and serve a traditional search index for questions/answers at scale

2. Speed

3. Quality: with search engines you don't just get one answer (you get a spectrum of answers). You have access to the "source" of those answers, which often include additional data that can help you choose the most appropriate solution to a problem.

In this specific case, the "horse" is the LLM - and the "car" is the traditional search engine with modern indexing technologies. But please, don't let simple textbook facts about technology take you off your trip.

Re:Behind the curtain: what it feels like to work in AI righ... by greeny7373 on Friday April 07, 2023 @06:13AM (#35480040)
I'm quite good in understanding the difference.

But LLM can already do things Google can't.

LLM is not just a search engine.

It's an explainer, rubber duck etc.

Instead of 'google define x' I just say ' explain x' in my dialog with the machine.

And it will only become better and better.

Re:Behind the curtain: what it feels like to work in AI righ... by teaearlgraycold on Friday April 07, 2023 @10:58AM (#35482223)
I remember cross referencing with Google to see where ChatGPT was pulling from and it wasn’t immediately obvious. So yes I probably could have found a guide through a search engine with more digging. But clearly the LLM is the superior product.
Re:Behind the curtain: what it feels like to work in AI righ... by pg_1234 on Friday April 07, 2023 @03:11AM (#35478997)
Probably because much of the time it's just a (hopefully correctly) curated subset of stack overflow ... tailored to your current focus.
Re:Behind the curtain: what it feels like to work in AI righ... by teaearlgraycold on Friday April 07, 2023 @10:55AM (#35482200)
Fine with me!
Re:Behind the curtain: what it feels like to work in AI righ... by throwaway2037 on Friday April 07, 2023 @04:17AM (#35479433)
Please write a blog post about this! That is an amazing story.
Re:Behind the curtain: what it feels like to work in AI righ... by teaearlgraycold on Friday April 07, 2023 @10:58AM (#35482227)
Which one?
Re:Behind the curtain: what it feels like to work in AI righ... by teaearlgraycold on Friday April 07, 2023 @10:27PM (#35489870)