Large language models reduce public knowledge sharing on online Q&A platforms

Re:Large language models reduce public knowledge sharing on ... by delichon on Sunday October 13, 2024 @10:43AM (#41828447)

I've gotten answers from OpenAI that were technically correct but quite horrible in the longer term. I've gotten the same kinds of answers on Stack Overflow, but there other people are eager to add the necessary feedback. I got the same feedback from an LLM but only because in that case I knew enough to ask for it.

Maybe we can get this multi-headed advantage back from LLMs by applying a team of divergent AIs to the same problem. I've had other occasions when OpenAI gave me crap that Claude corrected, and visa versa.

[ Parent | on HN ]

Re:Large language models reduce public knowledge sharing on ... by zmgsabst on Sunday October 13, 2024 @11:13AM (#41828715)

You can usually even ask the same LLM:

- do a task

- criticize your job on that task

- redo that task based on criticism

I find giving the LLM a process greatly improves the results.

[ Parent | on HN ]

Re:Large language models reduce public knowledge sharing on ... by roughly on Sunday October 13, 2024 @12:14PM (#41829197)

What’s fun is that you can skip step 1. The LLM will happily critique its own nonexistent output.

[ Parent | on HN ]

Re:Large language models reduce public knowledge sharing on ... by zmgsabst on Monday October 14, 2024 @05:23PM (#41842174)

So?

I too can write made up criticism if that’s what my boss wants in the workplace — but that doesn’t suddenly invalidate my ability to criticize my own work to improve it.

[ Parent | on HN ]

Re:Large language models reduce public knowledge sharing on ... by blazing234 on Sunday October 13, 2024 @11:29AM (#41828844)

How do you know the second result is correct? Or the third? Or the fourth?

[ Parent | on HN ]

Re:Large language models reduce public knowledge sharing on ... by phil-martin on Sunday October 13, 2024 @01:12PM (#41829672)

I approach it the same way as the things I build myself - testing and measuring.

Although if I’m truly honest with myself, even after many years of developing, the true cycle of me writing code is: over confidence, then shock it didn’t work 100% the first time, wondering if there is a bug in the compiler, and then reality setting in that of course the compiler is fine and I just made my 15th off-by-one error of the day :)

[ Parent | on HN ]

Re:Large language models reduce public knowledge sharing on ... by iSnow on Sunday October 13, 2024 @01:13PM (#41829688)

That's a smart idea I didn't think of.

I've been arguing with Copilot back and forth where it gave me a half-working solution that seemed overly complicated but since I was new to the tech used, I couldn't say what exactly was wrong. After a couple of hours, I googled the background and trust my instinct and was able to simplify the code.

At that situation, where I iteratively improved the solution by telling Copilot things seem to complicated and this or that isn't working. That led the LLM to actually come back with better ideas. I kept asking myself why something like you propose isn't baked into the system.

[ Parent | on HN ]

Re:Large language models reduce public knowledge sharing on ... by drawnwren on Sunday October 13, 2024 @01:57PM (#41830047)

The papers I've read have shown LLM critics to be quite bad at their work. If you give an LLM a few known good and bad results, I think you'll see the LLM is just as likely to make good results bad as it is to make bad results good.

[ Parent | on HN ]