Yes, these 100 miners are pools. But where pool participants will go then? Will pools who have not forked keep pool participation fees low?
Etc.
The game here is not quite simple. It is much more complex than appears at first sight.
Here’s a graph of the time blocks took over the last three years:
https://bitinfocharts.com/comparison/bitcoin-confirmationtim...
Look at the peaks and try to remember the issues that resulted in.
Second, instead of two weeks to hash rate adjustment, it will take four weeks.
And if these staying with this slow bitcoin would decide to leave to more profitable currencies (not necessarily Bitcoin, there are other SHA256-based PoW schemes), that will push hash rate adjustment even further into future.
https://www.cnbc.com/2021/07/03/bitcoin-mining-difficulty-dr...
We survived.