Of course. You and I don't have their economies of scale.
It’s about the real price of early microcomputers.
Until the frontier stabilizes, this will be the cost of competitive local inference. Not pretending what we can run on a laptop will compete with a data centre.
The same can't be said for local inference. It is always interior in experience and quality.
A reasonable home theater pays for itself over time if you watch a lot of movies. Plus you get to watch shows as well, which the limited theater program doesn't allow.
I can buy over 8 years of the Claude max $100 plan for the price of the 512GB M3 Ultra. And I can't imagine the M3 being great at this after 5 years of hardware advancement.
Not really. I do it because it offers me more control. That's higher quality in my book.
Try building a F1 car at home. I guarantee your unit cost will be several orders of magnitude higher than the companies who make several a year.
At that point you are almost paying more than the datacenter does for inference hardware.