Re:Show HN: I've built a locally running Perplexity clone
by bufferoverflow on Thursday April 04, 2024 @11:24PM
(#39938401)
No, a more appropriate analogy would be driving your own billion-dollar super-yacht vs driving your own car.
Will not happen any time soon. Consumer hardware can't even run GPT-4 locally, and won't be able for a looong time. Each GPT-4 instance runs on 8 A100. The cost of such system is ~$81K. Not even in the ballpark of what most consumers can afford.
Will not happen any time soon. Consumer hardware can't even run GPT-4 locally, and won't be able for a looong time. Each GPT-4 instance runs on 8 A100. The cost of such system is ~$81K. Not even in the ballpark of what most consumers can afford.