How do you pass a file descriptor through a socket? They just take bytes?

If you mean "I send some bytes that describes the file to open, and keep my processes in sync manually", of course you can do that, but true passing would allow a number of cool things.