News for hackers. Stuff that matters.
Re:Ask HN: Is it feasible to run a model on device for compl... by benoau on Sunday June 07, 2026 @10:07AM (#48435015)
It's technically feasible, really just a question of whether this is worth $10,000(s) to you and you're willing to spend it.
Re:Ask HN: Is it feasible to run a model on device for compl... by mazinz on Sunday June 07, 2026 @10:10AM (#48435048)
Why financially crippling? It’s free to run on device. The native Apple Intelligence works well for smaller context windows and text only.
Re:Ask HN: Is it feasible to run a model on device for compl... by benoau on Sunday June 07, 2026 @10:49AM (#48435407)
You can get poor results "for free" from your laptop, but the devices you need for the large models are very expensive.