You're right that a whitepaper isn't enough to be really sure. That takes disassembly of binaries and then you are still stuck with judging the trustworthiness of the hardware and I'm not sure how you solve that problem.