In theory I could deep dive into my Debian machine, but there are just so many things. Just think of the USB protocol compared to eg. a wanna-be implementation of RS232. There is no way I could get deep understanding of the whole system.

That said, I think you are correct in that there are less magic than you think when looking at the surface.