Re:Ask HN: How to offer AI services with my H100?
by talldayo on Wednesday January 01, 2025 @04:57PM
(#42569651)
If you didn't consider these things before buying an H100 then I frankly wonder why you even bought it in the first place. Was CUDA burning a $30,000 hole in your pocket or something?
[ Parent
| on HN ]
Re:Ask HN: How to offer AI services with my H100?
by jdthedisciple on Wednesday January 01, 2025 @05:07PM
(#42569721)
I acquired it to experiment with models firsthand and so far made myself a nice RAG-based webapp (in a rather niche field).
Would be nice if it paid for itself somehow though.
Re:Ask HN: How to offer AI services with my H100?
by serf on Wednesday January 01, 2025 @09:18PM
(#42571030)
I guess; but to anyone out there reading this : the cheapest available rtx with the memory you need is likely just fine for experimentation unless you're dead set on experimenting with some notoriously heavy hitting large-vram suites. no need for such heavy equipment just to experiment with.
although I understand the plight -- I routinely buy heavy equipment that is far and above beyond what I need and then fruitlessly hope for it to pay for itself , I have a garage full of such purchases!