Re:Small Models Have Arrived
by cjkaminski on Thursday August 27, 2026 @06:28PM
(#49472112)
Yes, and the technology to improve the interface you described is already available to run hundreds of concurrent instances on a 1U server. The barrier to entry is getting the people who manage those systems to care enough to implement something better.
[ Parent
| on HN ]
Fact. My company's largest partner is CoreWeave, and convincing leadership that we could run it ourselves on partner discounted hardware for a lot less money has gone nowhere.
Maybe you need to walk into the office with a $1000 server running a hundred instances of whatever your code does.