There's not necessarily a problem, but there are questions which Palantir and other providers could and should address using their contracts, source code and training/support availability.

If I offer you an axe, we can consider that a tool, and you can do good or evil with it. If I offer you a software-enabled axe and I'm able to turn that tool on/off at will, apply and/or withhold fixes and modifications, then who really holds the tool?