News for hackers. Stuff that matters.
Re:Open models by OpenAI by robwwilliams on Tuesday August 05, 2025 @08:05PM (#44806069)
Well river crossings are one type of problem. My real world problem is proofing and minor editing of text. A version installed on my portable would be great.
Re:Open models by OpenAI by cosmojg on Tuesday August 05, 2025 @11:48PM (#44807409)
Have you tried Google's Gemma-3n-E4B-IT in their AI Edge Gallery app? It's the first local model that's really blown me away with its power-to-speed ratio on a mobile device.

See: https://github.com/google-ai-edge/gallery/releases/tag/1.0.3

Re:Open models by OpenAI by 1123581321 on Wednesday August 06, 2025 @01:29AM (#44808020)
Dozens of locally runnable models can already do that.
Re:Open models by OpenAI by golol on Wednesday August 06, 2025 @02:41AM (#44808493)
I heard the OSSmodels are terrible at anything other than math, code etc.
Re:Open models by OpenAI by mark_l_watson on Wednesday August 06, 2025 @09:22AM (#44811636)
Yes, I always evaluate models on my own prompts and use cases. I glance at evaluation postings but I am also only interested in my own use cases.