If AI writes your code, why use Python?

Re:If AI writes your code, why use Python? by phillc73 on Tuesday May 12, 2026 @02:15AM (#48104826)

Thanks for that, I hadn't scrolled down far enough.

Just want to be sure I'm reading the results correctly... When I compare GPT-5.5 with Mistral Medium 3.5, I see in the tables:

a) Mistral beats GPT in Java and C++

b) It's close for Rust

c) GPT-5.5 easily wins for Go, Javascript, Python and Typescript

Model choice really does appear to be language dependent (assuming I'm reading the results correctly).

[ Parent | on HN ]

Re:If AI writes your code, why use Python? by gertlabs on Tuesday May 12, 2026 @02:52AM (#48105061)

The deeper you go into the filters (single models, cross correlated by specific languages), the smaller your sample sizes. A known limitation, tbh I doubt Mistral is better than GPT 5.5 at programming in any specific language and probably hit a few lower quality generations by GPT 5.5 by chance (but I could be wrong! We're always adding more samples so data improves over time. We always prioritize largest sample counts for near-frontier models first).

[ Parent | on HN ]