>Google started shipping 16GB as the _lowest_ amount of RAM you can get on your Pixel 9.
The Pixel 9 has 12GB of RAM[0]. You probably meant the Pixel 9 Pro.
Re:Open models by OpenAI
by username135 on Tuesday August 05, 2025 @10:33PM
(#44806991)
Still an absurd amount of RAM for a phone, imo
Re:Open models by OpenAI
by mrheosuper on Wednesday August 06, 2025 @12:10AM
(#44807548)
Not absurd. The base S21 Ultra from 2021 already shipped with 12GB ram. 4 Years later and the amount of ram is still the same
Seems about right, my new laptop has 8x that which is a about the same ratio that my last new laptop had to my phone at the time.
Re:Open models by OpenAI
by SchemaLoad on Tuesday August 05, 2025 @06:57PM
(#44805543)
Device makers also get to sell you a new device when you want a more powerful LLM.
Well, the model makers and device manufacturers of course!
While your Apple, Samsung, and Googles of the world will be unlikely to use OSS models locally (maybe Samsung?), they all have really big incentives to run models locally for a variety of reasons.
Latency, privacy (Apple), cost to run these models on behalf of consumers, etc.
This is why Google started shipping 16GB as the _lowest_ amount of RAM you can get on your Pixel 9. That was a clear flag that they're going to be running more and more models locally on your device.
As mentioned, it seems unlikely that US-based model makers or device manufacturers will use OSS models, they'll certainly be targeting local models heavily on consumer devices in the near future.
Apple's framework of local first, then escalate to ChatGPT if the query is complex will be the dominant pattern imo.