Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Ask HN: Why call it "inference" instead of just "model hosting"?.
I'd say "hosting" means making something available to you in the cloud. Model makers don't offer that.
They sell "inference," which is a compute task with real hardware costs for them. The task runs against their model, which is not hosted for you.
There are no comments on this comment yet.
I'd say "hosting" means making something available to you in the cloud. Model makers don't offer that.
They sell "inference," which is a compute task with real hardware costs for them. The task runs against their model, which is not hosted for you.