News for hackers. Stuff that matters.
Re:Enterprises in for a shock when they realize power and co... by nbuujocjut on Wednesday January 15, 2025 @11:37AM (#42713193)
Will most organisations be building out their own AI Infrastructure? I would guess in most cases they would either use APIs to existing models (OpenAI etc) or use cloud providers where they need to run and train their own models. Is there a risk that cloud providers cannot meet the demand?
Re:Enterprises in for a shock when they realize power and co... by pavel_lishin on Wednesday January 15, 2025 @11:41AM (#42713257)
Certain companies have very strict data handling requirements, and can't just send data off-site.
Re:Enterprises in for a shock when they realize power and co... by cptskippy on Wednesday January 15, 2025 @12:45PM (#42714338)
Yes, and those companies are a minority. I wouldn't be surprised if AI providers developed solutions for them. Almost immediately we saw tinybox emerge, old Tesla cards doubled and tripled in price on eBay, and Nvidia announced Digits so there's definitely interest in offline solutions.
Re:Enterprises in for a shock when they realize power and co... by PittleyDunkin on Wednesday January 15, 2025 @12:46PM (#42714353)
> Is there a risk that cloud providers cannot meet the demand?

Waste? Cloud providers are super expensive and can't generally justify this expense with the benefits of outsourcing.