I hadn't, but now I have.

Using mitmproxy to snoop my phone, I see that all the data coming into my computer when I open up Whatsapp Web is originating from my phone. Including pictures.

That being said, all of my current conversations are on the new "end-to-end-encryption" thing, which might make a difference.