Re:Ask HN: Did you buy hardware for Local AI?
by docshock on Friday November 20, 2026 @05:26PM
(#50583233)
Yes. The sweet spot for me was determined by what I already had and what was available at or near MSRP. I managed to find a 5080 last month at Walmart. Because I already had 96 GB of system RAM I settled on a mixture-of-experts model for my use case. I opted for NVIDIA Nemotron 3.5 Bolt 74B.
Yes, I continue to use cloud and frontier models. The cloud model is served as a backing model through NVIDIA Switchyard.
At this point I am using Claude pretty much for research only.
Yes, I continue to use cloud and frontier models. The cloud model is served as a backing model through NVIDIA Switchyard.
At this point I am using Claude pretty much for research only.