Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on I'm Not Convinced the AI Bubble Exists. Parent comment
I'm not sure if that is relevant here, but I've often seen people dramatically overestimate inference costs.
If we look at eg. https://inferencex.semianalysis.com/run/kimi-k31-pro-on-b300, it suggests that SOTA models are likely served in the API with profit margins in the ballpark of 98%.
There are no comments on this comment yet.
I'm not sure if that is relevant here, but I've often seen people dramatically overestimate inference costs.
If we look at eg. https://inferencex.semianalysis.com/run/kimi-k31-pro-on-b300, it suggests that SOTA models are likely served in the API with profit margins in the ballpark of 98%.