There needs to be a distinction between fundamental government functions (those that exist to establish the rule of law) and those that were created by law.

It's the fundamental government functions that should never be outsourced.

(If the people's will is that government take care of other matters, no problem. They can choose either way, provided the resulting laws are not unconstitutional.)