Not to mention the Fed chair and board is appointed by Congress. It's meant to be an indirect choice, but it is a choice none-the-less. It's just like how Supreme Court justices are appointed. They have similarly broad powers fairly far removed from the will of the people, moment to moment.