News for hackers. Stuff that matters.
Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by mu53 on Wednesday January 01, 2025 @05:54PM (#42569993)
If you ask about more niche language features or libraries, chatgpt will make up libraries or functions to fill the gap.

When asking an LLM to write a script for you, I would say 10 to 30 % of the time that it completely fails. Again, making up an API or just getting things straight up wrong.

Its very helpful, especially when starting from 0 with the beginner questions, but it fails in many scenarios.

There are no comments on this comment yet.