I mean, I'm not a JVM fan, but this sort of thing happens in lots of languages, and even operating systems. Upgrade from version X to X + 1, especially with lots of changes in everything else, and you're bound to hit different limits or explore the interface with limits you were hitting and didn't realize.

The other option is to never update anything; which is valid, but painful.