> and there's no good way to pipe raw bytes around (like, say, when you want to checkout a binary file from git).

Since pwsh 7.4 it can natively pipe the raw bytes between two external binaries and also when redirecting to a file. Sucks it took until then to get it but it's now there.