The hard part is finding an agent who will not try to convince you to do things to increase profits.

But yes, some artists have famously gone through intermediaries such that there isn’t a feedback loop possible.