Federal agencies are ultimately responsible to Congress and the President. The recent (last 20 years) trend towards deregulation and lax enforcement (IMO) starts at the top but most visibly manifests in the actions or inaction of regulators like the SEC.