News for hackers. Stuff that matters.
Re:Gemma3 – The current strongest model that fits on a singl... by archerx on Wednesday March 12, 2025 @06:45AM (#43341782)
That's why I like giving it a real world test. For example take a podcast transcription and ask it to make show notes and summary. With a temperature of 0 different models will tackle the problem in different ways and you can infer if they really understood the transcript. Usually the transcripts that I give it come from about 1 hour of audio of two or more people talking.
Re:Gemma3 – The current strongest model that fits on a singl... by antirez on Wednesday March 12, 2025 @01:43PM (#43345754)
Good test. I'm slowly accumulating private tests that I use to rate LLMs, and this one was missing... Thanks.