I think ubuntu-minimal is an empty package that depends on all the core system packages to be installed by default. If you remove it, nothing will happen immediately but the next autoremove will try to uninstall most of the system as it's no longer a required dependency of something.