Re:Hetzner is working on LLM Inference
by atherton94027 on Friday July 24, 2026 @02:54PM
(#49040113)
We're not even talking cutting edge. If you browse hetzner's auction page you can see they're renting machines with almost decade old CPUs like the Xeon W-2145 or i7 6700. That's just a lot of old hardware..
Re:Hetzner is working on LLM Inference
by idiotsecant on Friday July 24, 2026 @04:25PM
(#49041173)
So? If it's cheaper and gets the job done who cares?
Re:Hetzner is working on LLM Inference
by atherton94027 on Friday July 24, 2026 @05:55PM
(#49042077)
I mean if you run serious stuff on a non-ECC CPU from 2015, you'll probably have a bad time.
They're great for hobbyists but people on here keep bringing them up as the flagbearer of euro hosting
serious stuff like what? majority of people don't work on scale you probably are thinking about.
Re:Hetzner is working on LLM Inference
by swiftcoder on Saturday July 25, 2026 @03:28AM
(#49045316)
I have several production services running right now on AWS t2 instances, which were released in 2016. For a service that isn't performance-critical, it's perfectly fine (and a significant cost savings) to run on decade-old hardware.
ECC vs non-ECC is also pretty irrelevant on a box with < 64GB of memory
Re:Hetzner is working on LLM Inference
by atherton94027 on Saturday July 25, 2026 @11:57AM
(#49048711)
A t2 instance is virtualized, AWS keeps its servers for 5 years (see their 10k https://www.sec.gov/ix?doc=/Archives/edgar/data/1018724/0001... ), so your t2 does get moved around regularly to newer servers.
And no, ECC is relevant with less than 64 gigs of ram, there's a reason it's been a standard on servers since the 90s
Re:Hetzner is working on LLM Inference
by yjftsjthsd-h on Friday July 24, 2026 @05:53PM
(#49042057)
Well. Yeah. The auction page is the leftovers; if you want current stuff then you're in the wrong spot on their site
That's a pretty big part of why, honestly. How many of us are running server workloads that actually need the price/performance tradeoff of cutting edge server hardware?