News for hackers. Stuff that matters.
Re:Is a billion dollars worth of server lying on the ground? by throwaway894345 on Monday November 02, 2020 @12:50PM (#24970865)
I would guess SO had a relatively small number of employees and their servers were running a pretty straight-forward CRUD app and a database. Comparing that to the heterogeneous workloads that large organizations deal with is a bit silly. No doubt there's still a lot of fat to trim in those large organizations, but trimming that fat is rarely their largest opportunity (much to the chagrin of those of us who like simple, elegant systems).
Re:Is a billion dollars worth of server lying on the ground? by dzonga on Monday November 02, 2020 @02:01PM (#24971728)
my guy, you literally made me laugh. how's this https://stackexchange.com/performance different from any so called workloads large organizations are running. you've your app servers, db servers, load balancers and failover servers. pretty standard setup. yet SO is running on bare-metal. resume driven development and everyone thinking they're google | fb has killed and made money in our industry
Re:Is a billion dollars worth of server lying on the ground? by throwaway894345 on Monday November 02, 2020 @02:16PM (#24971900)
> how's this https://stackexchange.com/performance different from any so called workloads

StackExchange is largely a CRUD app. High volume of tiny requests that hit the app layer, then the database, and back. Other organizations have lower volumes of compute-intensive requests, async tasks, etc.

With respect to the size of an organization, the cost of coordinating deployments and maintenance over a handful of servers grows with the size of the organization. It frequently behooves larger organizations to allow dev teams to operate their own services.

None of this is to say that there isn't waste or poor decisions throughout our industry; only that it's not the sole factor and SO's isn't the ideal architecture for all applications.

> my guy

I'm not your guy.

Re:Is a billion dollars worth of server lying on the ground? by ksec on Monday November 02, 2020 @01:07PM (#24971055)
It is the World top 50 site by Alexa.

Comparatively speaking even compare them to the same CRUD app and DB, most are using 5 to 10x more servers with 1/2 to 1/5 of the traffic.

Re:Is a billion dollars worth of server lying on the ground? by notyourwork on Monday November 02, 2020 @01:41PM (#24971480)
It is a large site by traffic measure but I would guess the traffic is heavily read only. Managing workloads with more data mutation introduces different complexities which mean you can't just cache everything and accept the TTL for writes based on cache invalidation.

edit: To be clear, not saying SO isn't an achievement, but its one type of use case that yields a really simple tech stack.

Re:Is a billion dollars worth of server lying on the ground? by thu2111 on Monday November 02, 2020 @04:59PM (#24973940)
Their stats are here:

https://stackexchange.com/performance

Their DB handles peak of 11,000 qps and peaks at only 15% CPU usage. That's after caching. There are also some ElasticSearch servers. Sure, their traffic is heavily read only, but it's also a site that exists purely for user-generated content. They could probably handle far higher write loads than they do, and they handle a lot of traffic as-is.

What specific complexities would be introduced by an even higher write load that AWS specifically would help them address?

Re:Is a billion dollars worth of server lying on the ground? by throwaway894345 on Monday November 02, 2020 @01:31PM (#24971378)
> Comparatively speaking even compare them to the same CRUD app and DB, most are using 5 to 10x more servers with 1/2 to 1/5 of the traffic.

No doubt, but how large are those other CRUD app organizations? Do they have a staff that is 20x the size all trying to coordinate deployments on the same handful of servers? What are their opportunity costs? Is trimming down server expenses really their most valuable opportunity? No doubt that SO has a great Ops capability, but it's not the only variable at play.

Re:Is a billion dollars worth of server lying on the ground? by jldugger on Monday November 02, 2020 @02:54PM (#24972409)
And you can probably cache all the data you need for the next 24h in a few terrabytes of RAM, _if_ you knew what that data was.
Re:Is a billion dollars worth of server lying on the ground? by wazoox on Monday November 02, 2020 @01:08PM (#24971063)
I was thinking more of the ordinary startup than of large organizations.