News for hackers. Stuff that matters.

A comment on Making o1, o3, and Sonnet 3.7 Hallucinate for Everyone. Parent comment

Re:Making o1, o3, and Sonnet 3.7 Hallucinate for Everyone by andix on Saturday March 01, 2025 @02:57PM (#43223020)
With Claude the context window is quite small. But with adding too much context it often seems to get worse. If the context is not carefully narrowly picked and too unrelated, the LLMs often start to do unrelated things to what you've asked.

At some point it's not really worth anymore creating the perfect prompt, just code it yourself. Also saves the time to carefully review the AI generated code.

[ Parent | on HN ]
Re:Making o1, o3, and Sonnet 3.7 Hallucinate for Everyone by johnisgood on Saturday March 01, 2025 @04:37PM (#43223940)
Claude's context window is not small, is it not larger than ChatGPT's?
[ Parent | on HN ]
Re:Making o1, o3, and Sonnet 3.7 Hallucinate for Everyone by andix on Saturday March 01, 2025 @04:50PM (#43224071)
I just looked it up, it seems to be the rate limit that's actually kicking in for me.
[ Parent | on HN ]
Re:Making o1, o3, and Sonnet 3.7 Hallucinate for Everyone by johnisgood on Saturday March 01, 2025 @05:02PM (#43224170)
Yes, that's it! It is frustrating to me, too. You have to start a new chat with all relevant data, and a detailed summary of the progress/status.
[ Parent | on HN ]
Re:Making o1, o3, and Sonnet 3.7 Hallucinate for Everyone by johnisgood on Tuesday March 04, 2025 @01:57AM (#43251225)
(Because you reach the limit faster otherwise).
[ Parent | on HN ]