I recall working at a broker/dealer on Broadway where a curious sysadmin noticed a power cord that underneath an internal wall that fenced off "dead space." Said space turned out to contain a "forgotten" minicomputer living just outside a machine room.

I recall returning to a bank and discovering that router and load balancer admin passwords hadn't changed in seven years..