Government officials — at the federal level - have extremely well-defined scopes of authority. They have no general power to do things. If they exceed the scope, they are abusing the power given to them. A govt agency has no authority outside the scope of its enacting statute. That I what I meant by limited. It’s not a ‘made up’ concept. If an agent engages in ANY action outside its authority, it is exceeding its limited authority and acting outside the law. It as an abuse as the agent (or agency as a whole) is doing something ‘under color of law’ that Congress did not permit.
At the local level, there is a concept of ‘general’ police power where the limits of what your local deputy, for instance, can do is a bit more nebulous. But, not at the federal level.