News for hackers. Stuff that matters.
Re:Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison by nico on Monday March 31, 2025 @12:22PM (#43536785)
> I honestly don't think LLMs can code significant real-world things yet and I'm not sure how else to prove that since they can code some interesting things

In my experience it seems like it depends on what they’ve been trained on

They can do some pretty amazing stuff in python, but fail even at the most basic things in arm64 assembly

These models have probably not seen a lot of GTK3/4 code and maybe not even a single example of porting between the two versions

I wonder if finetuning could help with that

There are no comments on this comment yet.