News for hackers. Stuff that matters.
Re:OpenAI Needs $400B In The Next 12 Months by VBprogrammer on Friday October 17, 2025 @04:28PM (#45621654)
Yeah, but not just that. I don't expect my mum to go find some high end consumer GPU and install it on a home server in order to run her own local LLM. I expect that people will be throwing chat interfaces running remixed versions of open weight models out on the internet so fast that it's impossible for anyone to monitise it in a reasonable way.

I also wonder whether, similar to bitcoin mining, these things end up on specialist ASICS and before we know it a medium tier mobile phone is running your own local models.

Re:OpenAI Needs $400B In The Next 12 Months by fragmede on Friday October 17, 2025 @04:29PM (#45621663)
A top end iphone is capable of running smaller local LLMs today.
Re:OpenAI Needs $400B In The Next 12 Months by hbn on Monday October 20, 2025 @05:17PM (#45649489)
A few days late but the cheapest, base model iPhone, the 16e runs Apple Intelligence too

(Unfortunately... only Apple Intelligence right now...)

Re:OpenAI Needs $400B In The Next 12 Months by fragmede on Monday October 20, 2025 @05:52PM (#45649897)
I don't have a newer iphone to run it on, so I don’t have a specific one to recommend but searching for local LLM in the App Store gives plenty of options so you’re not limited to Apple Intelligence models.