News for hackers. Stuff that matters.
Re:Ask HN: What is one simple thing LLMs are insanely bad at? by jstrieb on Wednesday August 26, 2026 @01:00AM (#49444173)
Giving hints.

On math or programming problems, they are overfit to solving the entire thing end to end (presumably for benchmarks). I have had very poor results asking for pointers and hints that don't give away key insights. This has been the case across models I have tested.

An architecture with a "judge" that gates responses and ensures a lack of spoilers would probably work better. But this is a simple thing that they keep messing up.

Re:Ask HN: What is one simple thing LLMs are insanely bad at? by shepherdjerred on Wednesday August 26, 2026 @01:17AM (#49444286)
I haven't had this experience at all. I've used Cursor+Opus on homework e.g. to understand algorithms, but I usually prompt it with something like "DO NOT GIVE ME THE ANSWER, I care about understanding and solving this myself".
Re:Ask HN: What is one simple thing LLMs are insanely bad at? by jstrieb on Wednesday August 26, 2026 @02:35PM (#49453724)
Interesting! I periodically try it with new models and seem to get the same results. Maybe I'm not using enough capital letters :)