News for hackers. Stuff that matters.
Re:Is a billion dollars worth of server lying on the ground? by ksec on Monday November 02, 2020 @01:07PM (#24971055)
It is the World top 50 site by Alexa.

Comparatively speaking even compare them to the same CRUD app and DB, most are using 5 to 10x more servers with 1/2 to 1/5 of the traffic.

Re:Is a billion dollars worth of server lying on the ground? by notyourwork on Monday November 02, 2020 @01:41PM (#24971480)
It is a large site by traffic measure but I would guess the traffic is heavily read only. Managing workloads with more data mutation introduces different complexities which mean you can't just cache everything and accept the TTL for writes based on cache invalidation.

edit: To be clear, not saying SO isn't an achievement, but its one type of use case that yields a really simple tech stack.

Re:Is a billion dollars worth of server lying on the ground? by thu2111 on Monday November 02, 2020 @04:59PM (#24973940)
Their stats are here:

https://stackexchange.com/performance

Their DB handles peak of 11,000 qps and peaks at only 15% CPU usage. That's after caching. There are also some ElasticSearch servers. Sure, their traffic is heavily read only, but it's also a site that exists purely for user-generated content. They could probably handle far higher write loads than they do, and they handle a lot of traffic as-is.

What specific complexities would be introduced by an even higher write load that AWS specifically would help them address?

Re:Is a billion dollars worth of server lying on the ground? by throwaway894345 on Monday November 02, 2020 @01:31PM (#24971378)
> Comparatively speaking even compare them to the same CRUD app and DB, most are using 5 to 10x more servers with 1/2 to 1/5 of the traffic.

No doubt, but how large are those other CRUD app organizations? Do they have a staff that is 20x the size all trying to coordinate deployments on the same handful of servers? What are their opportunity costs? Is trimming down server expenses really their most valuable opportunity? No doubt that SO has a great Ops capability, but it's not the only variable at play.

Re:Is a billion dollars worth of server lying on the ground? by jldugger on Monday November 02, 2020 @02:54PM (#24972409)
And you can probably cache all the data you need for the next 24h in a few terrabytes of RAM, _if_ you knew what that data was.