News for hackers. Stuff that matters.
Re:All Of Argentina, Uruguay Without Electricity After Massi... by hfkajshfaks on Sunday June 16, 2019 @11:00AM (#20195774)
It isn't really though. A cascading failure can knock out an entire grid. The Northeast blackout is an example.

  A line goes out. 
  while (there some lines are still live):
    The current redistributes itself among neighboring lines.
    Neighboring lines trip
  end
  BlackStart()
BlackStart() is fun. Having your plants and grid down is like having a dead battery (plants use ~30% of the electricity they gen on themselves) and no one to give you a jump.

Usually the hydroelectric plants are started first. Arg. is lucky, they have a lot of those. Otherwise you need to fire up diesel generators (which hopefully have been maintained).

You give power to the grid first so you can start another plant.

Then you feed hospitals and continue firing the thermal plants.

Throughout all of this you have to keep phase stability (no grid, no phase reference). I'd assume this would limit renewable's use-fullness for re-start (a thousand 5Mw turbines out of phase are best left idling)

As a last step you turn on your nuclear plants (Arg. has a few). These are last because of nuclear poisons that accumulate from decaying wastes that weren't burned while the reactor was off.

It's a bloody hard problem.

Re:All Of Argentina, Uruguay Without Electricity After Massi... by 6thaccount2 on Sunday June 16, 2019 @11:27PM (#20199627)
Technically there is a last step you didn't mention. At some point after your island is ready, you'll want to reconnect with other islands. I've never done it in real life, but have done so in many simulations.

I forget the exact calculations involved (it's been years and I'm no longer involved with that area of operations), but you want to make sure your frequency matches the grid you're connecting with to within a certain amount. I think the stations which connect neighboring areas usually have extra monitoring equipment for a variety of energy accounting reasons, but also to measure the frequency on each side to see if it's a go or no go. I believe they use synchroscopes (https://en.wikipedia.org/wiki/Synchroscope) to do this.

Edit: it looks like y'all started talking about this below and I missed it, but the information is good, so I'm leaving it up.

Re:All Of Argentina, Uruguay Without Electricity After Massi... by sunkensheep on Monday June 17, 2019 @03:36AM (#20200726)
To connect two regions, we align the phase of the two islands. As the voltage across our switch bank falls to zero, we close the switches. It's not a big difference from between synchronizing a generator. The phase is aligned by requesting small changes to generator output, and measurement is done by synchrophasor.
Re:All Of Argentina, Uruguay Without Electricity After Massi... by nnq on Monday June 17, 2019 @07:13AM (#20201774)

    > Neighboring lines trip
    > As a last step you turn on your nuclear plants
...don't get it: why would you turn off your nuclear power plants, even if the grid failed?!

Won't it make more sense to keep it running as usual maybe just using the power to generate steam that you throw into the atmosphere? ...mainly because stopping and restarting a nuclear power plant is expensive af.?

(It still boggles my mind why are electric grids so focused on efficiency at the cost of resiliency... with abundant nuclear + hydro you could easily over-produce a bit, I'm 99% sure that making electricity dirt cheap for consumers by gov controlled over-production would help fight climate change even if it appears wasteful: there will be huge incentive to replace petrol burning trucks, buses, cars etc. when electricity it dirt cheap... and then prices can be gradually ramped up after everyone made the conversion.)

Re:All Of Argentina, Uruguay Without Electricity After Massi... by pjc50 on Monday June 17, 2019 @07:55AM (#20202002)
I'm not an expert, but there's an interesting discussion on Quora: https://www.quora.com/Can-an-American-nuclear-power-plant-bl...

The key factors seem to be:

1) the plant must be capable of running as an island. It seems not all of them are; I suspect the problem is the plant consuming a variable amount of self-power e.g. 1MW being connected to a 100MW generator results in a very unstable system.

2) whatever safety event causes the problem must not trip at the generators themselves but disconnect the plant cleanly from the grid. Since these events are by definition exceptional, this may be very hard to avoid.

> with abundant nuclear + hydro you could easily over-produce a bit

Both of these are exorbitantly expensive to build, and hydro requires specific geology.

Re:All Of Argentina, Uruguay Without Electricity After Massi... by snowwindwaves on Tuesday June 18, 2019 @12:40AM (#20209842)
Most of the plants I've worked on can't island themselves by design. It costs more to do it and sometimes requires additional or more expensive equipment, more attention to details in the design, and there is no point for a lot of generators that just get paid for MWh and they probably aren't going to generate many MWh islanded over the life time of the plant. Some generators even get paid for the energy they would have generated if the grid is down.

How many people have a manual transmission car just so they can pop the clutch if the batter is dead.

Re:All Of Argentina, Uruguay Without Electricity After Massi... by hfkajshfaks on Tuesday June 18, 2019 @07:25PM (#20219463)
I'm not in this field (university friends are), but reactors require triple redundancy for their power supply, including the grid.

A better question is, should we have nuclear power at all? I took classes in nuclear engineering, by friends are nuclear engineers, ect. but it's not obvious to me that cheap electricity is worth it.

Re:All Of Argentina, Uruguay Without Electricity After Massi... by nnq on Thursday June 20, 2019 @07:41AM (#20231814)
> not obvious to me that cheap electricity is worth it.

Why would you say that? I mean sure, if you can't manage to get cost-effectiveness right then it's not worth it. But otherwise dirt-cheap and readily available electricity is absolutely needed to solve the world's problems! Think about what will happen when large swaths of land loose access to drinking water after climate + pollution wreck things up and the only alternative is ocean water filtration and desalination plants that will need huuuge amounts of power! Also think about massive irrigation and civil engineering projects that will be needed to fight desertifications etc. And to keep heavily populated costal cities above (the new, higher) sea level. That's terrawats upon terrawats of energy that will be needed to constantly shuffle earth and water around, and maybe even to power huge city-scale air filters etc.

We have and still are wrecking up the planet to such a high extent that sooner or later the bill will arrive and we'll need to put heavy effort into re-terraforming Earth to keep it inhabitable... And there really is no other answer than nuclear here, while cities filled with LED-lights and low powered devices and highly thermally efficient buildings can run on renewables, heavy civil engineering projects and land decontamination and producing drinking water etc. will need waaay more power than our blanket of communication equipment and drones.

We could decide not to, but then we'll end up fighting for resources and instead of nuclear power with it's inherent risks we'll get... nuclear wars!

Re:All Of Argentina, Uruguay Without Electricity After Massi... by segfaultbuserr on Thursday June 20, 2019 @11:15AM (#20233729)
> >...don't get it: why would you turn off your nuclear power plants, even if the grid failed?!

> reactors require triple redundancy for their power supply, including the grid.

Thanks for posting. I learned something interesting today.

I can imagine the consequences of a total loss of power in nuclear reactors...

Re:All Of Argentina, Uruguay Without Electricity After Massi... by mulmen on Monday June 17, 2019 @12:12AM (#20199865)
Thanks for this, it is very informative and not something I had considered before.

I'm curious about the statement about renewables though because it seems that with wind or solar the production is very irregular even in normal operation. Doesn't that mean there has to be some technology to balance individual generator differences which would make re-starting those installations easier?

Re: Nuclear, how much energy is required to start up a nuke plant? If decaying toxins are a risk shouldn't those be prioritized? I might misunderstand what you mean by toxins, does that reduce production for some time?

Re:All Of Argentina, Uruguay Without Electricity After Massi... by Filligree on Monday June 17, 2019 @09:38AM (#20202779)
"Nuclear poisons" refers to neutron-absorbing substances produced through transmutation. When the reactor shuts down, it will continue to produce these for some time after the shutdown -- Xenon-135, particularly.

This proves problematic during reactor startup. Since it's absorbing neutrons, the controllers would need to retract the control rods further out than during steady state in order to achieve a replication rate of 1.0. However, xenon-135 stops being a nuclear poison after absorbing its neutrons... which means the replication rate will increase, and the reactor might run away.

This is part of what happened in Chernobyl, though they'd also disabled most of their safeties. (And dismantled the others.)

Regardless, nuclear poisons are something to keep a very careful eye on.

Re:All Of Argentina, Uruguay Without Electricity After Massi... by dredmorbius on Monday June 17, 2019 @11:39AM (#20204047)
True.

Xenon poisoning was discovered at the Hanford, Washington, B reactor during the WWII Manhatten Project.

https://www.osti.gov/opennet/manhattan-project-history/Event...

Re:All Of Argentina, Uruguay Without Electricity After Massi... by sunkensheep on Monday June 17, 2019 @03:45AM (#20200765)
There can be issues with a line-commutated inverter or asynchronous generation (wind-farms might have both) if the fault level is too low (synchronous plant too small or too distant). More recent research has shown the benefits of adding grid support (reactive power control, fault response) to the control system of renewable generation.

In future I would expect renewable and storage elements to provide black-start frequency reference.

Re:All Of Argentina, Uruguay Without Electricity After Massi... by apthnz on Sunday June 16, 2019 @05:47PM (#20198113)
What do you do for a living, and how can I learn more about it? This stuff fascinates me and you've explained it really well.
Re:All Of Argentina, Uruguay Without Electricity After Massi... by 6thaccount2 on Sunday June 16, 2019 @06:57PM (#20198484)
The user is probably a transmission level grid operator. These exist at most decent sized utilities (Entergy, AEP, Duke), although it is possible there is a TOP (transmission operator company) that is not the same as the utility.

There are also organizations like the RTO/ISO that also act like air traffic controllers for the grid by keeping it reliable. They also are usually responsible for committing and dispatching generation for dozens of utilities collectively to save money (by banding together, you need to carry less reserves or backup power and can leverage economies of scale). In North America these organizations are (CAISO, SPP, ERCOT, MISO, PJM, NYISO, and ISO-NE). All of these organizations practice black-start drills (I used to help run them) and have NERC certified operators.

Re:All Of Argentina, Uruguay Without Electricity After Massi... by hfkajshfaks on Sunday June 16, 2019 @10:57PM (#20199467)
"The user is probably a transmission level grid operator. "

Close. My dad's a power engineer, specifically grid protection.

Re:All Of Argentina, Uruguay Without Electricity After Massi... by 6thaccount2 on Sunday June 16, 2019 @11:07PM (#20199511)
If he's doing grid protection he's probably in distribution engineering and they would be pretty involved with a black start drill from as in they or the line crews with their boots on the ground as not all of that procedure can be initiated remotely I'd imagine.

The transmission level engineers and operators will call the shots as far as how the high level stuff goes down. In other words they'll issue a directive to get unit x online and then close in breaker b and clear a path to unit y while picking up load at z. The actual process from the end of the people doing that work is likely to be significantly more detailed.

Re:All Of Argentina, Uruguay Without Electricity After Massi... by hfkajshfaks on Sunday June 16, 2019 @11:12PM (#20199536)
"If he's doing grid protection he's probably in distribution engineering and they would be pretty involved with a black start drill from as in they or the line crews with their boots on the ground as not all of that procedure can be initiated remotely I'd imagine."

And has a nosy son ;)

Re:All Of Argentina, Uruguay Without Electricity After Massi... by MisterTea on Sunday June 16, 2019 @08:38PM (#20198878)
Honestly, I know that entire procedure myself as it's listed on a few different sites, one being the wikipedia blackout article. Then again this kind of stuff interests me so I read up on it.
Re:All Of Argentina, Uruguay Without Electricity After Massi... by 6thaccount2 on Sunday June 16, 2019 @09:30PM (#20199107)
I'm not sure you fully understand, or maybe it's me that misunderstands what you're saying :)

Each utility generally has its own black-start procedures. One utility might start two diesel generators (only really used for black-start) and then slowly start energizing the path to various loads and other generators. That utility and it's parent RTO/ISO train on that scenario several times a year and have the procedure printed in a binder within reach.

Something I've found interesting is that many of these plans are ~35 years old and we're created before computers were super common place for these kinds of things. The point being people weren't doing graph and optimization algorithms to determine the optimal paths. There has been a little university research and national lab research into this recently and I've heard they've helped certain utilities that they worked with determine some improvements, which is always exciting.

Re:All Of Argentina, Uruguay Without Electricity After Massi... by sboctrl on Sunday June 16, 2019 @09:00PM (#20198970)
The EPRI Power System Dynamics tutorial is a free resource that is really solid https://www.epri.com/#/pages/product/1016042/?lang=en-US.
Re:All Of Argentina, Uruguay Without Electricity After Massi... by 6thaccount2 on Sunday June 16, 2019 @11:29PM (#20199643)
Can confirm. This is one of THE best references out there for explaining a lot of key power systems topics. I didn't think it was publically available though?
Re:All Of Argentina, Uruguay Without Electricity After Massi... by sboctrl on Monday June 17, 2019 @09:54AM (#20202943)
It is one of the few products that is available to everyone. And frankly one of best deliverables from all EPRI programs. Period.
Re:All Of Argentina, Uruguay Without Electricity After Massi... by hfkajshfaks on Sunday June 16, 2019 @10:56PM (#20199457)
Lol. I'm a computational material scientist, so take everything w/ a grain of salt.

My dad's a power (line protection) engineer, everything I know is from talking to him.

Re:All Of Argentina, Uruguay Without Electricity After Massi... by davps on Monday June 17, 2019 @09:12PM (#20208973)
Right now I'm reading this book about this topic: Power System Stability and Control by Prabha Kundur https://www.amazon.com/System-Stability-Control-Prabha-Kundu...
Re:All Of Argentina, Uruguay Without Electricity After Massi... by mjevans on Sunday June 16, 2019 @02:05PM (#20196924)
The renewables depends on how they're connected to the grid. If they're DC charging a battery bank then presumably said bank can be treated as a single source so they'd be useful. Though it might be more efficient if they were also able to synchronize and direct-connect to the grid as AC.
Re:All Of Argentina, Uruguay Without Electricity After Massi... by segfaultbuserr on Thursday June 20, 2019 @11:20AM (#20233774)
> BlackStart()

I love how the people coming from different fields invented their own word for "the process of starting a system through external intervention because it cannot support itself at this point".

Kickstart. Jumpstart. Bootstrap. And now I learned a new one: blackstart.

Re:All Of Argentina, Uruguay Without Electricity After Massi... by lostlogin on Sunday June 16, 2019 @02:45PM (#20197162)
How is grid phase synchronised?
Re:All Of Argentina, Uruguay Without Electricity After Massi... by niftich on Monday June 17, 2019 @12:19AM (#20199905)
The following videos from BTCInstrumentation demonstrate this succinctly.

[1] Synchronizing AC generators -- Part 1 (introduction and sync lamps)

[2] Synchronizing AC generators -- Part 2 (strobe light view)

[3] Synchronizing AC generators -- Part 3 (sync and unsync)

[4] Synchronizing AC generators -- Part 4 (phase deviation)

The first video explains all the concepts and shows a sync, but the later videos bring additional conditions and detail.

[1] https://www.youtube.com/watch?v=RGPCIypib5Q [2] https://www.youtube.com/watch?v=sFohkp2aaU4 [3] https://www.youtube.com/watch?v=GRk_qJxaxh8 [4] https://www.youtube.com/watch?v=RT1ySBc-Bls

Re:All Of Argentina, Uruguay Without Electricity After Massi... by toomuchtodo on Sunday June 16, 2019 @03:43PM (#20197476)
https://hackaday.com/2017/07/05/how-do-they-synchronize-powe...

Phase is monitored on both sides of the connection, and high voltage contactors complete the circuit when tolerances are met.

Re:All Of Argentina, Uruguay Without Electricity After Massi... by amelius on Sunday June 16, 2019 @05:50PM (#20198124)
But if you have a grid with a large number of nodes, how do you impose which node is running at the correct (reference) frequency and phase? Do the edges of the grid impose a master-slave relationship?
Re:All Of Argentina, Uruguay Without Electricity After Massi... by amaterasu on Sunday June 16, 2019 @06:29PM (#20198366)
I'm trivialising the problem, but whichever station energises the grid first becomes the reference. An operating grid has what may as well be infinite inertia (it isn't infinite of course), so new stations coming online must match it (or try and change the phase of the grid to match theirs). I visited a power station in Melbourne many years ago, and they have the shattered remains of a turbine and generator that was connected with a phase mismatch.
Re:All Of Argentina, Uruguay Without Electricity After Massi... by hfkajshfaks on Sunday June 16, 2019 @11:02PM (#20199491)
"In the event that there's a phase mismatch, I assume that gets physically transmitted back to the generating device?"

In case of phase mismatch, you have a short circuit and the weakest element along the short gets fried.

Re:All Of Argentina, Uruguay Without Electricity After Massi... by ethbro on Sunday June 16, 2019 @10:50PM (#20199430)
In the event that there's a phase mismatch, I assume that gets physically transmitted back to the generating device? (Mode subject to type of device) Or am I over-trivializing it?

E.g., will an out of phase turbine have a physical resistance against it, as a consequence of the rest of the grid?

Re:All Of Argentina, Uruguay Without Electricity After Massi... by Filligree on Sunday June 16, 2019 @11:16PM (#20199562)
Of a sort. If it's a phase mismatch of a few degrees, the generator may attempt to physically rotate to match the phase.

This kills the generator. Also, less amusingly, anyone nearby at the time.

If it's a larger mismatch, then that's more likely to fry the wiring before too much other damage happens. On rare occasions generators get connected while they are (exactly) 180 degrees out of phase; this is a dead short, and its internals will instantly vaporize. The vaporized copper may then proceed to explore the outer limits of the generator's physical integrity.

(Disclaimer, etc: I've only worked with DC generation, AC would be somewhat different especially if it's three-phase.)

Re:All Of Argentina, Uruguay Without Electricity After Massi... by snowwindwaves on Tuesday June 18, 2019 @12:23AM (#20209769)
I've synced 10 mw 900 rpm hydro units as much as 7 degrees out of phase. There is a bit more of a thunk as the unit snaps in to sync but it's not the end of the world.

Diesel units in hospitals will sync to each other as much as 30 degrees out of sync because just get thing online because it the load is critical.

I've also been told two second hand reports of the breaker closing drastically out of sync. One was a person closing the breaker manually when the unit was stopped. It essentially just puts a fault on the machine and it trips right away. Another case the close circuit was poorly designed and has only one relay, whose contacts eventually failed but happened to fail welded closed, and in conjunction with a poorly maintained breaker that developed a variable delay between the close coil being energized and actually closing. It made a big boom like faults do but the unit synced after the relay was replaced and breaker maintained and is fine.

Maybe medium and larger units with more inertia have tighter tolerances. Over certainly heard of broken shafts and generators being ejected through concrete walls.

A nice party trick is to do phase matching instead of syncing with slip so I can keep the unit exactly in phase with the grid as long as the grid doesn't wobble too much. This keeps the sync scope needle exactly at 12 o clock so you can close the breaker to put the unit online at will. Unfortunately i don't often get the budget for The additional inputs to get the nice phase difference signal so I can't perform my trick.

Re:All Of Argentina, Uruguay Without Electricity After Massi... by Filligree on Tuesday June 18, 2019 @09:49AM (#20212929)
It depends entirely on how much inertia there is on the shaft, in various forms. The example I was told about was a 200MW peltier, constructed such that rotating it backwards implies pushing back against the water. The shaft itself also had some sort of extra equipment on it, but I'm not sure of the details.

Well, when it was connected about 30 degrees out of phase, the entire unit pretty much exploded. It tore out of the concrete base, and was found to have rotated nearly halfway to the "correct" position.

I haven't seen anything nearly that dramatic myself, so I can't be sure how much it's exaggerated. There's probably a report somewhere.

And I love that party trick. There's no direct equivalence in DC transmission, of course, but I've done similar things with voltage-matching in Electrical Age. It always amazes me how much that game ends up reflecting reality.

Re:All Of Argentina, Uruguay Without Electricity After Massi... by sunkensheep on Friday June 28, 2019 @11:32PM (#20310667)
Water is a bit less forgiving than steam, it has great resistance to changes in position or velocity. I suspect that closing the generator created a water-hammer, which physically or mechanically destroyed the machine.
Re:All Of Argentina, Uruguay Without Electricity After Massi... by sunkensheep on Monday June 17, 2019 @06:02AM (#20201400)
If the phase is not quite matched, you get power swing and mechanical oscillation. If you get it very wrong expect pole slip http://supachaisabua.blogspot.com/2013/09/2.html?m=1
Re:All Of Argentina, Uruguay Without Electricity After Massi... by amelius on Monday June 17, 2019 @04:31AM (#20200978)
Ok but imagine a circular grid of N nodes. Following the circle, the stations are connected to the grid. Of course there is a small, inevitable mismatch at every connection. Then, when connecting the last node, you might get a problem which can only be solved by adjusting the settings at the other nodes.
Re:All Of Argentina, Uruguay Without Electricity After Massi... by pjc50 on Monday June 17, 2019 @09:39AM (#20202788)
It turns out that this can be a substantial problem, resulting in wasted loop flows: https://iopscience.iop.org/article/10.1088/1367-2630/18/10/1...

Generally systems try to avoid too much loop power in the first place for this reason, setting up a directed but acyclic graph with some redundancy links carrying zero or near-zero power as standby.

Re:All Of Argentina, Uruguay Without Electricity After Massi... by rtkwe on Monday June 17, 2019 @11:04AM (#20203668)
The grid doesn't really pass through each of the points though so you don't really get the frequency mismatch between one side of a node on the grid and another. Instead of a ring of nodes it's closer to a ring with nodes hanging off of it so you never really get two frequencies observed at one power station because it's only connected to the rest of the grid at a single point.
Re:All Of Argentina, Uruguay Without Electricity After Massi... by sboctrl on Sunday June 16, 2019 @09:06PM (#20198996)
The reference frequency is interconnection wide. To bring a three phase ac generator online the terminal voltage, phase rotation, frequency, and phase angle must be within some tolerance.
Re:All Of Argentina, Uruguay Without Electricity After Massi... by snowwindwaves on Tuesday June 18, 2019 @12:35AM (#20209820)
What type of power plant has 30% of nameplate rating on station service loads?

I've been to about 30 stations under 50 MW and the biggest station load might have been 300 kW if they had all the heaters, fans, pumps, crane, welders, air compressors, and gates operating at the same time.