> On the one hand, "chaos engineering" seem a bit like "we don't understand our architecture well enough to know what its failure modes are, [...]

That approach seems like a good idea, even if you think you know what the failure modes are.