News for hackers. Stuff that matters.
Re:Show HN: GPU-Accelerated Inference Hosting by maldeh on Tuesday July 13, 2021 @01:18AM (#27817810)
The pricing appears to be static per model with a ceiling on the monthly request count, not charged per request.

Edit: Actually, I didn't spot the free tier of 1000 requests. I wonder how you avoid the problem of a lot of users leaving defunct/disused models running while still keeping them hot - presumably some kind of limit to the model count?

There are no comments on this comment yet.