News for hackers. Stuff that matters.
Re:Why the push for Agentic when models can barely follow a ... by addandsubtract on Tuesday October 14, 2025 @05:52AM (#45578096)
What deal is GitHub Copilot getting then? They also offer all SOTA models. Or is the performance of those models also worse there?
Re:Why the push for Agentic when models can barely follow a ... by rhim on Tuesday October 14, 2025 @07:54AM (#45578928)
> Or is the performance of those models also worse there?

The context and output limit is heavily shrunk down on github copilot[0]. That's the reason why for example Sonnet 4.5 performs noticeably worse under copilot than in claude code.

[0] https://models.dev/?search=sonnet+4.5

Re:Why the push for Agentic when models can barely follow a ... by laborcontract on Tuesday October 14, 2025 @06:11AM (#45578215)
Github Copilot is likely running models at or close to cost, given that Azure serves all those models. I haven't used Copilot in several months so I can't speak to its performance. My perception back then was that its underperformance relative to peers was because Microsoft was relatively late to the agentic coding game.