News for hackers. Stuff that matters.
Re:Gemma 4 on iPhone by ulfw on Monday April 06, 2026 @02:56AM (#47657732)
It runs very fast on my Qualcomm Elite Gen 5 SoC Oppo Find N6
Re:Gemma 4 on iPhone by allpratik on Monday April 06, 2026 @03:11AM (#47657806)
How many tokens per second? Also, does it get warm/hot?
Re:Gemma 4 on iPhone by modeless on Monday April 06, 2026 @03:20AM (#47657861)
If this Gemma tokenizer I found online is accurate then my Pixel 10 Pro XL is getting ~22 tok/s on Gemma 4 E2B using the NPU, vs. 40 tok/s is what people are saying the MLX version gets on iPhone.

Actually I found official performance numbers from Google saying iPhone gets 56 tok/s and Qualcomm gets 52. They don't even bother listing Tensor in their table. Maybe because it would be too embarrassing. Ouch! https://ai.google.dev/edge/litert-lm/overview