News for hackers. Stuff that matters.
Re:Is a billion dollars worth of server lying on the ground? by giantrobot on Monday November 02, 2020 @03:24PM (#24972782)
While infrastructure astronauts are typically money wasters and padding their resumes, I don't think SO is the best counter example.

SO's read to write ratio is enormous. While they talk about a handful of different bare metal servers a vast majority of their hits are handled by their caching layer which is not one of their bare metal machines.

Their write loads are not explicitly time sensitive either, if there's a delay between a successful post and cache invalidation it's not a big deal for a majority of their traffic.

Not every model is quite so forgiving. But even then there's a lot of stupid wasteful "infrastructure" made by people who think they're going to be Google, or at least tell their investors they'll be Google.

Re:Is a billion dollars worth of server lying on the ground? by thu2111 on Monday November 02, 2020 @04:53PM (#24973878)
Well, it's an interactive database backed web site. That describes like maybe 90% of the things running on AWS.

StackOverflow is useful because it reminds people that machines are fast, and you probably don't need that many of them to scale to large sizes. StackOverflow is used by the entire global population of developers more or less and it runs off of one large MS SQL Server + some web servers. No auto scaling (not enough hw expense to be worth it), no need for fancy cloud LBs etc.

Sure maybe your service is gonna scale to more than the world's population of developers. Great. But ... a lot of services won't even go that far. For them it's hard to conclude it's really needed.

To pull off a StackOverflow you do need skilled sysadmins though. As the article points out, a surprisingly large number of people who call themselves devops don't really know UNIX sysadmin anymore.

https://stackexchange.com/performance

Re:Is a billion dollars worth of server lying on the ground? by dx034 on Tuesday November 03, 2020 @03:45AM (#24977710)
Autoscaling is overused anyway. It's cheaper and much less complex to have 200-300% of average capacity running 24/7 on dedicated servers (OVH/Hetzner, whatever) than trying to scale up and down according to demand.

Changing capacity automatically always has the potential to backfire. And as AWS & Co need to keep those servers running during times of less demand there's no way it's cheaper unless you have really unusual traffic patterns (even then it's probably not).

Re:Is a billion dollars worth of server lying on the ground? by giantrobot on Monday November 02, 2020 @05:43PM (#24974344)
You're not wrong but it's worth noting SO as a case study for site design has some important caveats. Beefy hardware is great but aggressive caching and setting same expectations around write latency can be a massive scaling win.