News for hackers. Stuff that matters.
Re:Major AWS Outage Happening by jedberg on Monday October 20, 2025 @01:20PM (#45646505)
Way back when I worked at eBay, we once had a major outage and needed datacenter access. The datacenter process normally took about 5 minutes per person to verify identity and employment, and then scan past the biometric scanners.

On that day, the VP showed up and told the security staff, "just open all the doors!". So they did. If you knew where the datacenter was, you could just walk-in in mess with eBay servers. But since we were still a small ops team, we pretty much knew everyone who was supposed to be there. So security was basically "does someone else recognize you?".

Re:Major AWS Outage Happening by E39M5S62 on Monday October 20, 2025 @02:59PM (#45647770)
That sounds like an Equinix datacenter. They were painfully slow at 350 E. Cermak.
Re:Major AWS Outage Happening by jedberg on Monday October 20, 2025 @03:28PM (#45648116)
It wasn't Equinix, but I think the vendor was acquired by them. I don't actually blame them, I appreciated their security procedures. The five minutes usually didn't matter.
Re:Major AWS Outage Happening by chasd00 on Monday October 20, 2025 @03:23PM (#45648048)
way back when DC's were secure but not _that secure_ i social engineered my way close enough to our rack without ID to hit a reset button before getting thrown out.

/those were the days

Re:Major AWS Outage Happening by jedberg on Monday October 20, 2025 @03:26PM (#45648089)
Just to test the security, or...?
Re:Major AWS Outage Happening by chasd00 on Tuesday October 21, 2025 @10:43AM (#45656451)
late reply but, no, i really needed to hit the button but didn't have valid ID at the time. My driver's license was expired and i couldn't get it renewed because of a outstanding tickets iirc. I was able to talk my way in and had been there many times before so knew my way around and what words to say. I was able to do what i needed before another admin came up and told me that without valid ID they have no choice but to ask me to leave (probably like an insurance thing). I was being a bit dramatic when i said "getting thrown out" the datacenter guys were very nice and almost apologetic about asking me to leave.
Re:Major AWS Outage Happening by bandrami on Monday October 20, 2025 @11:32PM (#45652184)
Oh I've definitely done that. They had remote hands but we were over our rack limit and we didn't want them to see inside.

The early oughts were a different time.

Re:Major AWS Outage Happening by UltraSane on Monday October 20, 2025 @05:28PM (#45649610)
I was in a datacenter when the fire alarm went off and all door locks were automatically disabled.
Re:Major AWS Outage Happening by johnisgood on Tuesday October 21, 2025 @03:38AM (#45653405)
Lmao, so unathorized access on demand by pulling the fire alarm?
Re:Major AWS Outage Happening by folmar on Tuesday October 21, 2025 @04:38AM (#45653741)
Don't ask about fire power switch
Re:Major AWS Outage Happening by UltraSane on Tuesday October 21, 2025 @07:55AM (#45654742)
Essentially yes. They should really divide data centers into zones and only unlock doors inside a zone where smoke is detected.
Re:Major AWS Outage Happening by ectospheno on Tuesday October 21, 2025 @10:24AM (#45656221)
Because surely every smoke detector will work while the building is burning down…
Re:Major AWS Outage Happening by UltraSane on Tuesday October 21, 2025 @11:28AM (#45657013)
most data centers are made out of concrete and isolate fires.
Re:Major AWS Outage Happening by ectospheno on Tuesday October 21, 2025 @03:18PM (#45660353)
My point is that while the failure rate may be low the failure method is dude burns to death in a locked server room. Even classified room protocols place safety of personnel over safety of data in an emergency.
Re:Major AWS Outage Happening by UltraSane on Wednesday October 22, 2025 @07:21PM (#45676413)
Being in a server room with FM200 fire control is the safest place to be in a fire.
Re:Major AWS Outage Happening by chasd00 on Tuesday October 21, 2025 @10:50AM (#45656547)
> They should really divide data centers into zones and only unlock doors inside a zone where smoke is detected.

just make sure the zone based door lock/unlock system isn't on AWS ;)

Re:Major AWS Outage Happening by chasd00 on Tuesday October 21, 2025 @10:48AM (#45656517)
There's some computer lore out there about someone tripping a fire alarm by accident or some other event that triggered a gas system used to put out fires without water but isn't exactly compatible with life. The story goes some poor sys admin had to stand there with their finger on like a pause button until the fire department showed up to disarm the system. If they released the button the gas would flood the whole DC.
Re:Major AWS Outage Happening by fragmede on Tuesday October 28, 2025 @01:37PM (#45736057)
Halon, yes.
Re:Major AWS Outage Happening by anthonyeden on Tuesday October 21, 2025 @06:35PM (#45662600)
Most modern commercial buildings in Australia unlock doors when the fire alarm goes off.
Re:Major AWS Outage Happening by terminalshort on Monday October 20, 2025 @06:59PM (#45650499)
> So security was basically "does someone else recognize you?"

I actually can't think of a more secure protocol. Doesn't scale, though.

Re:Major AWS Outage Happening by peterbecich on Tuesday October 21, 2025 @03:31AM (#45653378)
I would imagine this is how it works for the President and Cabinet
Re:Major AWS Outage Happening by goatking on Tuesday October 21, 2025 @12:10PM (#45657548)
Well, you put a lot of trust in the individuals in this case. A disgruntled employee can just let the bad guys in on purpose, saying "Yes they belong here".
Re:Major AWS Outage Happening by terminalshort on Tuesday October 21, 2025 @02:45PM (#45659891)
That works until they run into a second person. In a big corp where people don't recognize each other you can also let the bad guys in, and once they're in nobody thinks twice about it.
Re:Major AWS Outage Happening by 0x457 on Tuesday October 21, 2025 @01:14PM (#45658428)
Vulnerable to byzantine fault.
Re:Major AWS Outage Happening by ermis on Tuesday October 21, 2025 @06:41PM (#45662657)
or it could be some troy maybe.