News for hackers. Stuff that matters.
Re:Small Models Have Arrived by Animats on Thursday August 27, 2026 @04:53PM (#49471112)
Good point.

Dumb AIs are needed for customer service. Most of that industry is still at "press 1 for sales, 2 for billing..." and needs something that will run locally on a 1U server.

Re:Small Models Have Arrived by cjkaminski on Thursday August 27, 2026 @06:28PM (#49472112)
Yes, and the technology to improve the interface you described is already available to run hundreds of concurrent instances on a 1U server. The barrier to entry is getting the people who manage those systems to care enough to implement something better.
Re:Small Models Have Arrived by MrDrMcCoy on Thursday August 27, 2026 @09:27PM (#49473329)
Fact. My company's largest partner is CoreWeave, and convincing leadership that we could run it ourselves on partner discounted hardware for a lot less money has gone nowhere.
Re:Small Models Have Arrived by inigyou on Thursday August 27, 2026 @10:19PM (#49473608)
Maybe you need to walk into the office with a $1000 server running a hundred instances of whatever your code does.
Re:Small Models Have Arrived by MrDrMcCoy on Friday August 28, 2026 @12:01AM (#49474205)
We got rid of all our offices, whole company is remote now.
Re:Small Models Have Arrived by Someone on Friday August 28, 2026 @01:35AM (#49474738)
> Most of that industry is still at "press 1 for sales, 2 for billing..." and needs something that will run locally on a 1U server.

Needs? Customers want something that immediately answers their question/solves their problem, but that’s far away, even ignoring the “run locally on a 1U server” and that that may not be in the company’s interest.

For many companies, that support line is a cost center, not a PR mechanism.

Also “Press 1 for sales, 2 for billing...” has the big advantage that it handles all accents, speech impediments, etc.

Long term I think a solution where a user’s agent trained on their voice, running on their phone communicates with the support agent of a company is where we will end up, and support phone lines will cease to exist.