Pee bootloader runs on the gpu, so that doesnt matter much. Current bootloader can bootstrap ARM in 64bit mode, as is evidenced by freebsd port and https://www.raspberrypi.org/forums/viewtopic.php?f=72&t=1379... (all but the gpu works)