Not having to tied them together into a single process space is an interesting option/ability which would get lost with using it as a library.

Having the authorizer integrate based on contract feels like an option which allows for more freedom of choice and variety of implementations.

I do not believe in one size fits all, nor that there is one to rule them all.