> It makes me pine for tarballs built on boxes w/ compilers installed and deployed directly onto the filesystem of the target machines.

You're effectively describing Gentoo.

Just a personal opinion but it's awesome.