Why is much of our legacy software suddenly failing us if we are so much better at finding intricate bugs than the LLM's? Why are all of us easily capable of speeding up our software by orders of magnitude in small amounts of time utilizing them. Yes, they are better at verification as well.
I share a similar experience with bug finding; I think it also helps that LLMs can simply hold much more context at once than a human, as seeing a much larger portion of the codebase simultaneously makes it much easier to spot discrepancies.
As for legacy software suddenly failing us, what you're really talking about are active systems like Microsoft 365 (it's not legacy code). Those systems have always been complex. That they are "suddenly" failing could be an indication of a number of things, but I'd pin a large part of the responsibility on organizational debt (even beyond technical debt). Maintaining complex software systems is hard, software mostly isn't a static thing it has to constantly evolve. It could also be an indication of over-reliance on LLM competency, for all we know about those system's internals. We just don't know enough to make an assessment.
There have been some zero days discovered by LLMs. There have also been many socially engineered, regular old exploits that have been impressed on us as indications of AI breakouts.
As for speedups, most software is comically unoptimized and has been for some time. We made an explicit trade-off in software development as CPUs and machines got more capable: we started coding in simpler languages with higher levels of abstraction (Python, Ruby, JS, Java, etc) sometimes costing us 10x or more in resource utilization, in exchange for the iteration speed that bought us. Converting those to more efficient languages like Go, Rust, C, etc alone buys you so much. On top of that, there are a number of algorithmic optimizations most developers never implemented that map to well known access patterns in hardware. Lots of low hanging fruit.
If you've tried to build anything nontrivial with LLM you know this just isn't true.