> I think doing this kind of thing successfully requires making good decisions about which dependencies you consider to be part of the system and which dependencies you want to include with your application.

Herein lies the problem, because Linux has absolutely no distinction between "system" and "application". Everything is part of the system.