Re:Show HN: GPU-Accelerated Inference Hosting
by _hl_ on Tuesday July 13, 2021 @03:50AM
(#27818521)
That's impressive!
Are you willing to talk a bit about how this all works? I assume you host the hardware yourself somewhere, which in the days of AWS et al must be pretty tough to pull off, especially with these specs. Where do you get the hardware from these days with the crypto craze?
Re:Show HN: GPU-Accelerated Inference Hosting
by theo31 on Tuesday July 13, 2021 @09:52AM
(#27820963)
Yes! A more in-depth blog post is coming soon. We do host the hardware ourselves, for complete control over the GPUs. We found a great infrastructure provider that is also experiencing shortages.
Are you willing to talk a bit about how this all works? I assume you host the hardware yourself somewhere, which in the days of AWS et al must be pretty tough to pull off, especially with these specs. Where do you get the hardware from these days with the crypto craze?