News for hackers. Stuff that matters.
Re:Any Day Can Be Prime Day: How Amazon Uses Chaos Engineeri... by Tomis02 on Tuesday September 05, 2023 @08:17PM (#37399670)
> Not all req/s are made the same. > Amazon search is made of 100s of services, and Amazon's search page loads 20 products per page, that means 80k search req/s translates to 1.6 MM product API req/s for example.

That's their problem, no? Nobody's forcing them to have an architecture where a request propagates to hundreds of services.

Re:Any Day Can Be Prime Day: How Amazon Uses Chaos Engineeri... by dmoy on Tuesday September 05, 2023 @08:37PM (#37399852)
> That's their problem, no? Nobody's forcing them to have an architecture where a request propagates to hundreds of services.

Well, Jeff Bezos circa 2002 or so did:

https://news.ycombinator.com/item?id=3102800

It's hard to remove that ethos now

Re:Any Day Can Be Prime Day: How Amazon Uses Chaos Engineeri... by hughesjj on Wednesday September 06, 2023 @01:52PM (#37408565)
And thank God he did, amazon would have direct without the SOA enforcement.

Scale issues are emergent issues. It's a phase transition.

Re:Any Day Can Be Prime Day: How Amazon Uses Chaos Engineeri... by txcwpalpha on Tuesday September 05, 2023 @08:54PM (#37399981)
Why is it anyone's "problem"? Nobody said they're being forced to do it this way - just that they are. And I guarantee that there are thousands of other companies out there that have an API-fanout model as well, and might be interested in how Amazon does it.

I don't get the hostility around this article. Nobody is forcing you to read it or to do it this way. If your system is architected in a different way where you can run your whole system on a single instance, then good for you! But Amazon presumably doesn't have that luxury, and others may not either.

Re:Any Day Can Be Prime Day: How Amazon Uses Chaos Engineeri... by yazaddaruvala on Tuesday September 05, 2023 @09:10PM (#37400125)
> That's their problem, no? Nobody's forcing them to have an architecture where a request propagates to hundreds of services.

I mean, physics kinda is.

Just the volume of data that needs to be hosted, needs multiple nodes. ElasticSearch has some good general documentation of search engines if you want to learn more. In Amazon's case, a general query will hit a fanout of about 10,000x nodes - I wasn't even counting that fanout because it is all technically 1 service.

Meanwhile, Bun.js (no offense to Bun) is built for IO-bounded workloads and 65k req/s is great for that. However, executing the required Natural Language Processing (i.e. multiple ML models) would result in an exhausted CPU (even if Bun could distribute the compute across cores or compute the ML inference on a GPU). I'd be willing to bet even on a great CPU it gets throttled at 10 req/s (at most 100 req/s).

This really isn't some "They should have just done it all in Postgress, Bun.js can just use a nice ORM and be IO-bounded" type situation - which is a philosophy I very much agree with for 99.9999% of usecases.

Re:Any Day Can Be Prime Day: How Amazon Uses Chaos Engineeri... by NBJack on Tuesday September 05, 2023 @09:37PM (#37400365)
I suspect it grew into that. Amazon has been around for almost 30 years. That's a long time to incrementally change a service ecosystem.
Re:Any Day Can Be Prime Day: How Amazon Uses Chaos Engineeri... by yathaid on Wednesday September 06, 2023 @05:50AM (#37403085)
My favorite kind of HN answer. 100% snark, 100% certain, 100% wrong.

So, instead of that, what would you have? A single, binary that makes multiple DB calls? Hmmm, let's see, some people have tried that and written extensively about the problems they faced doing that. Wait, one of them is actually a small e-commerce firm named after a larger river. Wonder what the issues were ...