Re:Effective AI code suggestions: less is more
by jimminyx on Wednesday January 29, 2025 @03:45PM
(#42870930)
The attention is probably just latching on to strong statistical patterns. Obvious errors create sharp spikes in attention weights, and drown out more subtle signals that can actually matter more
The author seems to be implying it could be: "Even a single mention of ‘code enhancement suggestions’ in our instructions seemed to hijack the model’s attention"