And yeah, the desktop VAXen were almost exclusively for VMS. But the standard Unix box in the early-mid 80's that everyone talked about when they discussed/benchmarked/whatever the platform was a 11/780 running 4.2BSD. Those aren't meaningfully collectible for an individual, obviously.
But indeed the servers are really hard for collectors because of the size. Similarly with the real PDP's of the day. We had a real PDP-11 at the computer museum where we volunteered though we never turned it on. Too afraid of a cap blowing and damaging more.
HP had some nice small servers later on, but they were not very influential so like you I don't really see a benefit in collecting them.
From before, we had a VAX 11/750. It, too, was a freestanding box in the computer room, possibly close to a cubic meter in volume. Not something I would want at home! It ran VMS, which I found clunky and difficult to work with. But we got a Unix emulation layer called Eunice installed on it, which made it more bearable.
By the way what are you looking for? A VAX or a SPARCstation? VAXes are indeed very hard to come by, and I didn't realise they were ever the "reference unix box" - weren't they more common for VMS? But somehow I never came across them back in the day. I think part of the reason is that they mainly sold servers, they weren't that big on the workstation market.
Sun, SGI and HP-UX I used a lot, HP-UX the most. I still have two HP-UX workstations at home.