News for hackers. Stuff that matters.

A comment on Building resilient services at Prime Video with chaos engineering.

Re:Building resilient services at Prime Video with chaos eng... by raverbashing on Monday August 24, 2020 @05:31AM (#24258898)
One thing I wonder (and find difficult to simulate) are failures in external services. Sure you can unit test your function with a 500 for example, but you never know in which ways the function/library can fail

(Not to mention the cases where it says everything worked but it didn't)

[ Parent | on HN ]
Re:Building resilient services at Prime Video with chaos eng... by neo01124 on Monday August 24, 2020 @09:58AM (#24260677)
The article does talks about how to inject latency or packet-loss into calls to particular external services. This should help you test many service->dependency failure scenarios around retries, timeouts and circuit-breakers.

Injecting specific error codes or exceptions is a bit more complicated but it is possible with other approaches, for example: Chaos toolkit.

[ Parent | on HN ]