This is probably such an old system that it has a power button that is not connected to the motherboard but is directly between the mains power and the PSU. In that case releasing the button would mean that the server is just depowered just like you hold the button for a few seconds on a modern system.

This is also why those computers said "It's now safe to disable the power" after shutting down.