Here's an idea of what it was like:
We had a lot of them, with full configuration, at full load. Go, figure.
They can generate a lot of heat though.
To be fair, they ARE impressively CPU dense
"Proper" 1U servers feel more like a thing for larger places, where density starts to matter more. Not sure why so many comments here focus on 1U.
However with an iLO or iDRAC license, they're joy to administer and use. They're also very reliable too.
For home use servers, if you want 1U form factor, you can take a look at Dell's shallow 1U servers. They're pretty modestly powered but small, I think relatively silent and easy to maintain.
Higher end servers have some fun features like advanced BMCs and such, but they come with relevant price tags, power consumption and noise.
You can also look at SME tower servers.
But yeah as soon as you put an unsupported HDD or extension card in there, it'll assume the worst and spin everything full blast.
In an HPC environment that doesn't matter much, anyway. Heh.
In a 1U server, you're running 5-7 tandem mounted, counter rotating Delta fans which can spin up to 18KRPM. They're in a confined space, have big cores to drive them and they need to supply a blanket of airflow to get things cool.
Higher efficiency components and a good implicit airflow design affects much more than the fans themselves, since there's not much space to optimize the fan design itself compared to the airflow as a whole inside the server.
Moreover, more intelligent system management solutions with more sensors both inside the chips and on the motherboard allows the BMC to see the whole picture and manage these fans in a more informed manner.
I'm not aware of the any other servers, switches or actively cooled equipment tried to do that.
IBM BladeCenter H is the worst offender: "Is acoustic management enabled? No? OK, everything is at full speed, then".