The problem isn't the specific policy, the problem is that right now the people who will be empowered and enriched the most by any theoretical "good at stuff" AI are the same people who already spend mountains of cash and effort stopping those things.

How will a functional AI model do anything other than make them better at getting the outcomes they want? CEOs and the megarich have never had any problems watching people burn for their bank account.