> this should just allow one to use yum/apt/etc instead of manually downloading from yet another 3rd party

That wouldn't work on its own. You also need something like pkg-config so you know how to build against the packages. You need to know about indirect dependencies and include search paths for instance.