News for hackers. Stuff that matters.
Re:Hetzner is working on LLM Inference by rebelde on Friday July 24, 2026 @08:35AM (#49034685)
Hetzner is very efficient hosting servers

Will this be the new division of labor?

Americans - best proprietary models

Chinese - best open weight models

Europeans - best / most efficient inference service

Re:Hetzner is working on LLM Inference by andsoitis on Friday July 24, 2026 @08:39AM (#49034734)
We need frontier open weight models from the West.

Maybe Nvidia's Nemotron can get there.

https://research.nvidia.com/labs/nemotron/Nemotron-3-Ultra/

Re:Hetzner is working on LLM Inference by 9dev on Friday July 24, 2026 @09:33AM (#49035317)
There is no "West" anymore, at least not in the sense it was used in the last 50–70 years. There is now Europe/Canada/Australia on the one side, and the USA as an adversary on the other, and that won't change in the foreseeable time.

What we need is frontier open weight models in the EU, Canada, and Australia.

Re:Hetzner is working on LLM Inference by slashdev on Friday July 24, 2026 @09:48AM (#49035594)
Give it two years more then it changes again.
Re:Hetzner is working on LLM Inference by 9dev on Friday July 24, 2026 @10:52AM (#49036566)
It won't. That's the point many people don't seem to get: The people who wanted everything that is happening now don't just go away. There is no guarantee they won't vote for a narcissistic grifter again, and thus any long-term decisions building on mutual trust and stability can't be made. How could you justify investing into a factory that relies on a 20 year ROI window when tariffs could be changing every day? Why would you want to use an AI model that could be restricted to US citizens or taken away entirely without notice?

Big, slow wheels have turned everywhere around the world. They won't turn back so easily.

Re:Hetzner is working on LLM Inference by slashdev on Saturday July 25, 2026 @06:18PM (#49052244)
Meh. No matter which side gets in power it’s almost certainly a narcissistic grifter. Who wasn’t over the last twenty years? The current one is a bit of a long term aberration, that doesn’t have to be the norm going forward.

In fact you could argue he was a response to some of the more extreme positions on the Democrat side.

I’m hoping things move more towards the center. But that may be only a fools hope.

Re:Hetzner is working on LLM Inference by ForHackernews on Friday July 24, 2026 @08:47AM (#49034806)
why?
Re:Hetzner is working on LLM Inference by andsoitis on Friday July 24, 2026 @08:53AM (#49034859)
Reasons include, but are not limited to:

a) broad competition is good

b) jurisdiction diversification (you don't want to be dependent on the regulatory winds of a single jurisdiction)

Re:Hetzner is working on LLM Inference by ForHackernews on Friday July 24, 2026 @08:57AM (#49034906)
...but you're not dependent on anyone?

If I'm running a Kimi model on my local cluster, the CCP can't shut it off.

It's not like the Finnish government has veto power over Linux.

Re:Hetzner is working on LLM Inference by andsoitis on Friday July 24, 2026 @09:15AM (#49035088)
You're not necessarily wrong for now, but that framing might be too narrow.

It is not beyond imagination that a government can limit availability to future frontier versions of the open weight models produced within their jurisdiction.

It pays to be a little paranoid and have a diversified portfolio of options to choose from. Anything that can have major geopolitical consequence is especially susceptible to such structural risk.

This has nothing to do with any particular government/country/jurisdiction except insofar as said country is a leading power and hence has immense leverage across a very wide range of dimensions. Said more plainly, it is safe to assume that a country with immense power is unlikely to be willing to cede or distribute such power to others.

If you're hung up on my choice of "the West", consider that I mean it geopolitically and economically, so broadly includes North America, Europe, Australia, New Zealand, Japan, and South Korea. I could have also said the Global South, but I think it is a fair statement that none of those countries have the means, but I'd be totally cool and happy if I'm proven wrong!

Re:Hetzner is working on LLM Inference by frangonf on Friday July 24, 2026 @08:48AM (#49034815)
I read that data centers in Frankfurt use 40% of city energy, and seems that some fossil fuel based workarounds are being pushed. I hope we do better than the US in the energy and data center gold rush.