News for hackers. Stuff that matters.
Re:That UPS you bought for your home server may not be as us... by jcrawfordor on Monday August 10, 2020 @01:09PM (#24111543)
Some military equipment, especially naval, has something called a "battleshort" where electrical protections can be disabled during combat, where losing equipment could be more dangerous than electrical hazards. It's interesting to think about whether this could be applied to DC environments, but honestly, I think few DCs actually have this kind of risk aversion for downtime. Alternatives like precautionary replacement of generators that have been oversped probably come at too high of a cost, not to mention that many of those false-positive-prone protective devices are there to reduce risk of fire.
Re:That UPS you bought for your home server may not be as us... by btown on Monday August 10, 2020 @06:18PM (#24114720)
https://en.wikipedia.org/wiki/Battleshort

> According to Allied Ordnance Publication AOP-38-3,[1] a NATO publication, a battleshort is "The capability to bypass certain safety features in a system to ensure completion of the mission without interruption due to the safety feature." It also says, "Examples of bypassed safety features are circuit overload protection, and protection against overheating".

> For example, the electrical drives to elevate and traverse the guns of a combat warship may have "battleshort" fuses, which are simply copper bars of the correct size to fit the fuse holders, as failure to return fire in a combat situation is a greater threat to the ship and crew than damaging or overheating the electrical motors.

> Battleshorts have been used in some non-combat situations as well, including the Firing Room/Mission Control spaces at NASA during the manned Apollo missions — specifically the Moon landings.

As a side note, with great apology to those who may have lost their lives due to the consequences of real-world battleshorts - this is actually a really interesting analogy for the "war room" scenarios we find ourselves in at startups. Risking damage to morale and productivity can be acceptable if the alternative is irrecoverable loss of the startup's reputation. But this also can't be a sustained state of affairs - these types of procedures are meant for a battle, and risk compounds if you don't return to a steady state. Perhaps adding "battleshort" to our lexicon would make it clear that "doing things that don't scale" is often necessary but not without its costs.

Re:That UPS you bought for your home server may not be as us... by vosper on Monday August 10, 2020 @10:33PM (#24116638)
> Perhaps adding "battleshort" to our lexicon would make it clear that "doing things that don't scale" is often necessary but not without its costs.

... And 6 months later marketing people will have commandeered it, without regard to the original meaning, and they’ll be asking people to battleshort so they can really be agile and lean in on providing air cover via the updated sales deck.

Re:That UPS you bought for your home server may not be as us... by blaser-waffle on Tuesday August 11, 2020 @09:19AM (#24119982)
That sentence triggered me like 3 times.

Doubly so because I used to be in the US military but now live in a different country, and it's crazy to see how those terms and acronyms infect a lot of US business culture.

A decade ago I would have been fine, even glad, that I could wrap myself in verbiage that would jive with poor career choices I made at 18. Now it just feels incongruous or jingoistic.

Re:That UPS you bought for your home server may not be as us... by btown on Tuesday August 11, 2020 @02:28PM (#24123916)
It's the good old "military-industrial complex" - except with the psychoanalytical sense of the word "complex."
Re:That UPS you bought for your home server may not be as us... by btown on Tuesday August 11, 2020 @08:29AM (#24119593)
“It’s okay team we’ll just push hard and discuss how to avoid this in the retrospective”
Re:That UPS you bought for your home server may not be as us... by xmprt on Tuesday August 11, 2020 @12:39AM (#24117211)
This made me sad. I was so excited to find this new term that I was looking forward to using.
Re:That UPS you bought for your home server may not be as us... by vosper on Tuesday August 11, 2020 @02:46AM (#24117776)
Ahh, please don’t let my cynicism stop you!
Re:That UPS you bought for your home server may not be as us... by p_l on Tuesday August 11, 2020 @03:31AM (#24118038)
Too late man, too late.

We're now sharpening pitchforks to use on the next salestrooper that comes close to the SalesBell™

/s

Re:That UPS you bought for your home server may not be as us... by helldritch on Monday August 10, 2020 @06:31PM (#24114855)
This is one of those comments I so rarely see where what I already know is put in to words I've never been able to find.

Thank you for this, I'll be updating our documentation to include these concepts first thing tomorrow.

Re:That UPS you bought for your home server may not be as us... by nine_k on Monday August 10, 2020 @05:43PM (#24114348)
Most of military equipment is built to be able to operate outside the safety bounds, because the enemy in a battle is actively trying to push it outside these safety bounds and outright destroy it. Burning down your afterburner chamber and winning a fight is better that preserving it and losing the whole aircraft.

In a datacenter though your bets are usually much lower. Nobody is going to die, or lose many millions, if some of your equipment shuts down to prevent it from being damaged, catching a fire, etc.

There are though high-stake situations where you want exactly that: spend the entire amount of the resources of certain hardware to prevent a loss of life, or of untold millions, when you are powering a surgery chamber, or a large stock trading operation.

People who realize that do over-provision and pay top dollar for that when they can afford that. I remember that when a major fire occurred in one of the skyscrapers in the financial district of NYC, traders of a particular financial company were evacuated with their laptops into helicopters on the roof, and ferried to a spare office across Hudson river, in NJ. To minimize the impact of that, they connected to the corporate network via their phones as hotspots, and kept trading while airborne.

Of course one cannot hope to pull such an operation off without extensive preparation and likely regular drills.

Not preparing to a black swan event during a high-stakes event, like translation of a Superbowl match, sounds like either not having enough paranoia which is professionally required, or, more likely, as a cost-cutting after a wrong assessment of risks.

Re:That UPS you bought for your home server may not be as us... by brianwawok on Monday August 10, 2020 @09:18PM (#24116247)
That sounds a lot harder than having half of each team in two separate buildings. If one needs to shut down the secondary team just takes the full load...
Re:That UPS you bought for your home server may not be as us... by nine_k on Tuesday August 11, 2020 @01:58AM (#24117546)
(1) I don't think the other building was an office they kept full-time; it could even have been a hotel.

(2) Think about hiring twice as much senior programmes, just in case. Good day traders are even more expensive.

Re:That UPS you bought for your home server may not be as us... by blaser-waffle on Tuesday August 11, 2020 @09:25AM (#24120028)
> (2) Think about hiring twice as much senior programmes, just in case. Good day traders are even more expensive.

Day traders are expensive? I thought a lot of those folks keep what they kill, and when they screw up they don't get to eat. "Coffee for closers," etc.

Re:That UPS you bought for your home server may not be as us... by nine_k on Tuesday August 11, 2020 @12:19PM (#24122088)
If they trade for themselves, sure. (It's like school kids who can build a funny enough game in Scratch.)

If they trade for a large corporation, with the leverage provided by that corporation, it's a whole another ballgame.

Re:That UPS you bought for your home server may not be as us... by imgabe on Monday August 10, 2020 @07:55PM (#24115666)
Electrical codes in the US are very clear that they care much, much more about preventing fires than preventing loss of power. The one exception is the fire pump that provides water pressure to the sprinkler system, since if that's running there's already a fire.

The owner of the datacenter's aversion to downtime is not going to be a concern to the building inspector or the fire marshal.

Re:That UPS you bought for your home server may not be as us... by zaarn on Tuesday August 11, 2020 @09:14AM (#24119937)
Fire supression systems basically run their own electrical code.

At one of my previous workplaces I learned a bit about our local firecode in relation to electrical code. Mostly that firecode supersedes electrical code. The fire alarm is running of a 230V line (standard) without grounding (non-standard) via a special line from the upstream power transformer that has higher amperage tolerance.

All the fire detectors are powered and wired from this at 40-70V, no ground or if there is a ground, it's grounded at the control panel of the fire alarm system.

In the event of a fire, the entire system is rated about 10X over it's standard ratings. The wires that are allowed to handle 1 Amp before are now allowed to go to 10 Amps, just in case there is a short this might burn it out and allow other equipment to operate.

I've seen some systems that are "optionally fused", they have an internal relais that's held by external power and if the fused lines fail, it automatically switches to unfused power, where the alarm system can evaluate the condition and decide to go back to the fused line if power returns. That's on top of having it's own backup batteries. Some of the more modern systems have watchdogs systems built in so that in case the fire alarm computer is on fire, it won't switch to the unfused line once the computer is no longer operational.

Re:That UPS you bought for your home server may not be as us... by angry_octet on Wednesday August 12, 2020 @01:41AM (#24128900)
I think you will find that those circuits use isolation transformers and have no path to earth normally -- if you touch active and normal building earth there is no circuit.

At to amperage ratings, don't you just mean that they have a 10x safety factor? Probably using current limiting supplies that can handle a short circuit. Fire circuits (and the feed from the main panel) should use fire rated cabling -- generally mineral insulated copper sheathed cables. Most of the standards (NFPA 75/76) are moving away from being prescriptive to being risk or performance based though, so it is possible they used normal conduit if the overall risk was small.

Incidentally, hospitals also make extensive use of isolation transformers for wet areas (like emergency / ICU), to provide a local point for resetting breakers (electronically), identifying which point is tripping, etc, see IEEE 602-2007. Much better filtering for medical equipment too. You also tend to see positive retention plugs (in the US, green dot UL 817).

Re:That UPS you bought for your home server may not be as us... by zaarn on Wednesday August 12, 2020 @02:42AM (#24129192)
The cables have fairly high ratings but in the even of a short circuit, the ratings have a safety margin of about 10x that the cable can last about 6 hours under, above the normal rating under standard conditions (ie, not fire).
Re:That UPS you bought for your home server may not be as us... by wvh on Monday August 10, 2020 @05:19PM (#24114119)
Many years back I had the opportunity to visit one of those data centres at the heart of Europe's financial operations. In case of fire, you had a minute or so to get out, because then the place is pumped full of argon. I guess that's a DC variation of your "battleshort"...
Re:That UPS you bought for your home server may not be as us... by robaato on Monday August 10, 2020 @06:11PM (#24114629)
Worked on a project in late 80s for an Italian bank. We implemented a SWIFT (financial) interface (on Stratus for reliability reasons). A few fun and games:

- The Stratus supposedly had fault tolerant duplexing of boards - pull one out and the other keeps working. A famous demo where local consultant pulls out the only board which wasn't duplicated!

- The machine room was also fire proofed with Halon gas (if I recall correctly), but due to security concerns the door was locked from inside by operators when present (luckily as programmers we weren't expected to work inside with doors locked!). Luckily also, it was my first exposure to "paired programming"/"paired operating" as in there were invariably 2 of them.

- A couple of the operators became too interested in how to work things, and wrote a quite comprehensive manual. They were "moved on" within the bank, because for security, management only wanted "people who could follow instructions", not "who can think for themselves".

- the whole headquarters building was in a guarded compound, where ultimate protection against "red brigade terrorists" (https://en.wikipedia.org/wiki/Red_Brigades) were the armed guards. We used to meet them in the ground floor cafe every mid-morning, with a revolver on their hip, while they drank an espresso with brandy chaser. Really inspired confidence that they would be there to protect us should the need arise!

Re:That UPS you bought for your home server may not be as us... by consp on Monday August 10, 2020 @07:03PM (#24115164)
> They were "moved on" within the bank, because for security, management only wanted "people who could follow instructions", not "who can think for themselves"

And this is why we cannot have nice IT security practices.

Re:That UPS you bought for your home server may not be as us... by frabert on Monday August 10, 2020 @05:52PM (#24114435)
Interesting, one of the guys that worked on my Uni's DC told us that the fire suppressor system is interlocked: to enter the DC, you need to open a door using a key. Upon opening the door, the fire extinguishing system is disabled, and is only enabled when the door is closed. The people working in the DC are supposed to keep the key on themselves. Also, they used Halon 1301 instead of Argon as the gas.
Re:That UPS you bought for your home server may not be as us... by mark-r on Monday August 10, 2020 @06:16PM (#24114695)
Halon is a CFC and isn't legal anymore due to international agreements.
Re:That UPS you bought for your home server may not be as us... by myself248 on Monday August 10, 2020 @11:38PM (#24116943)
Yeah, you can't install new Halon 1211 systems, but it's still out there. New systems are usually FM-200 or Inergen, which I believe can use the same plumbing as Halon.

Older systems, before Halon was invented, are typically CO2 or Argon. They require a lot more agent to accomplish the job, but they're very simple.

I worked briefly in a CO2 datacenter. It dated from the mainframe era, and had some gorgeous mementos on the walls. There were SCBA packs in the hallway outside, and everyone got a brief safety lecture before being allowed into the facility. The point I remember was basically "The alarm will sound intermittently for twenty seconds, then go solid for five, before discharge. If it goes off, do not stop to save your files, just run for the door. If you're not outside yet when the solid tone sounds, hold your breath and run on what's in your lungs."

Apparently the CO2 is considerably nastier than Halon to get a lung-full of...

Re:That UPS you bought for your home server may not be as us... by mark-r on Tuesday August 11, 2020 @12:42AM (#24117223)
Yes, carbon dioxide is not biologically inert like Halon is. It's the signal your body uses to say it's out of oxygen. You will definitely react negatively to getting a lung full of it.
Re:That UPS you bought for your home server may not be as us... by Doxin on Tuesday August 11, 2020 @03:23AM (#24117986)
For reference: It's not a lack of oxygen that causes the sensation of asphyxiation. It's a surplus of CO2. It'd essentially be the gas-based equivalent of waterboarding.
Re:That UPS you bought for your home server may not be as us... by zaarn on Tuesday August 11, 2020 @09:23AM (#24120018)
A large surplus of CO2 is also toxic, regardless of how much oxygen you have (see: Apollo 13).
Re:That UPS you bought for your home server may not be as us... by frabert on Monday August 10, 2020 @06:24PM (#24114779)
I must have confused it with some other fire suppression system I heard of, then!
Re:That UPS you bought for your home server may not be as us... by mark-r on Monday August 10, 2020 @06:31PM (#24114858)
Oh Halon was very popular for a long time. I don't know how long they could be grandfathered, but recharge supplies must be impossible to get by now.
Re:That UPS you bought for your home server may not be as us... by chipsa on Tuesday August 11, 2020 @12:02AM (#24117056)
https://en.wikipedia.org/wiki/Clean_agent_FS_49_C2

Looks like there's a drop in replacement for Halon.

Re:That UPS you bought for your home server may not be as us... by sbierwagen on Tuesday August 11, 2020 @09:34PM (#24127800)
Amusingly, tetrafluoroethane and pentafluoroethane are themselves being phased out in refrigeration applications because of their sky-high global warming potential, thousands of times worse than CO2.
Re:That UPS you bought for your home server may not be as us... by dividedbyzero on Monday August 10, 2020 @05:30PM (#24114218)
What would they do in case of injured/incapacitated people in there? Seems conceivable that some things that could start a fire might cause that as well.
Re:That UPS you bought for your home server may not be as us... by brewdad on Monday August 10, 2020 @05:40PM (#24114324)
Name a server rack after those who gave the ultimate sacrifice.
Re:That UPS you bought for your home server may not be as us... by captn3m0 on Monday August 10, 2020 @02:54PM (#24112698)
Re:That UPS you bought for your home server may not be as us... by Unklejoe on Monday August 10, 2020 @04:46PM (#24113788)
We use something similar on turbocharged drag (grudge) racing cars.

The boost controller has a "scramble" button which overrides the preset boost targets and allows you to run a higher (and unsafe) boost level as long as the button is pressed.

This is useful when you're in the middle of a $10,000 race and you're losing by a few feet.

Re:That UPS you bought for your home server may not be as us... by segfaultbuserr on Monday August 10, 2020 @05:33PM (#24114256)
What, this is real?! I already thought it was a Hollywood movie plot.
Re:That UPS you bought for your home server may not be as us... by Unklejoe on Monday August 10, 2020 @10:14PM (#24116548)
Yes, definitely real! Although what you're probably thinking of is nitrous oxide injection. One popular manufacturer of nitrous oxide systems is "NOS", which was featured heavily on the Fast & Furious movies.

The "scramble" button I'm talking about is for "boost", which is the amount of positive air pressure inside the intake manifold.

Both "boost" and nitrous can dramatically increase power by essentially getting more oxygen into the combustion chamber, but nitrous is a much more dramatic effect.

Re:That UPS you bought for your home server may not be as us... by bluGill on Monday August 10, 2020 @08:42PM (#24116000)
All motorcycle mechanics have a sign "speed costs money, how fast do you want to go". It isn't a joke, most of them can get as much power out of a 500cc motor as industrial engines get out of 19 liters. The catch is that you have to rebuild the engine every 10 hours of operation, while the industrial engine will run non-stop for many years.
Re:That UPS you bought for your home server may not be as us... by blaser-waffle on Tuesday August 11, 2020 @09:27AM (#24120047)
Those industrial engines also don't turn you into a meat crayon if you make a minor screw-up.
Re:That UPS you bought for your home server may not be as us... by bluGill on Tuesday August 11, 2020 @02:45PM (#24124191)
Sure they do, run away engines are a real problem. They will sometimes start using their own oil as fuel, and at that point you better run. (modern engines have safety air shutdowns)
Re:That UPS you bought for your home server may not be as us... by kitteh on Monday August 10, 2020 @09:05PM (#24116162)
A320 and B737 had special thrust bump modes for short fields like KSNA. Going back many years to the P&W JT8D you could operate in the red provided you did it for only a certain amount of seconds and logged it down.
Re:That UPS you bought for your home server may not be as us... by repiret on Monday August 10, 2020 @10:45PM (#24116691)
In general aviation aircraft it’s quite common for there to be time limits on the highest power setting.
Re:That UPS you bought for your home server may not be as us... by p_l on Tuesday August 11, 2020 @03:37AM (#24118065)
There's a maximum power mode selectable on the FADEC interface, which gives you at least 30 minutes of engine life - any use means the engine needs total overhaul.

This mode is pretty much reserved for go around or post V1 takeoff when one engine on twin engined airliner had failed.

Re:That UPS you bought for your home server may not be as us... by irontinkerer on Monday August 10, 2020 @04:32PM (#24113655)
“ the P-51H Mustang was rated at 1,380 hp, but WEP would deliver up to 2,218 hp”

Wow!

Re:That UPS you bought for your home server may not be as us... by linsomniac on Monday August 10, 2020 @04:44PM (#24113764)
Indeed. I forget where I read it, but it provides that power increase for (IIRC) some small double digits number of seconds before you need to throttle back, or the engine eats itself. If you are able to make it back to base, and that WEP wire is broken, the engine needs a rebuild before it flies again. Definitely an impressive power boost though.
Re:That UPS you bought for your home server may not be as us... by tomatotomato37 on Monday August 10, 2020 @07:29PM (#24115439)
The MiG-25 also have something similar where the engine redline is marked around Mach 2.8, but there's no system stopping the pilot from keeping it maxed to somewhere above Mach 3 but damaging the engine in the process.

Funnily enough I believe the SR-71 has the opposite problem, where the engines would merrily go above Mach 3.5 with no issue but the airframe and everything attached to it would get torn apart by the intense heat if the pilot tried to go any faster

Re:That UPS you bought for your home server may not be as us... by chipsa on Tuesday August 11, 2020 @12:11AM (#24117090)
No, SR-71s are still limited by engine temperature. They measure the Compressor Inlet Temperature, but I suspect that actual limitation is the turbine inlet temp. That said, it'll merrily try to go above that without issue if you don't throttle back.

Additionally, there's the Mach Cone. The shock wave off the nose forms a cone shape, with the angle determined by the speed of the aircraft. From the nose to the wingtip forms an angle of about 17.5 degrees, which corresponds well with the max speed from the CIT of Mach 3.3.

That both methods of determining max speed agree shouldn't be surprising. Skunk Works was filled with good engineers.

Re:That UPS you bought for your home server may not be as us... by p_l on Tuesday August 11, 2020 @03:40AM (#24118086)
MiG-31 has limiter on engine controls connected to airspeed and mach number indicators, because the engine will happily run above Ma 3, with no issues.

The airframe, however, will get bent from temperature and you better hope the missile cooling loops don't fail.

The power isn't dialed down at lower speeds in order to provide thrust for maneuvering and climb.