Decommission is brutally expensive too.
That's budgeted as part of the (still remarkably low) operating costs. In the US at least, anybody operating a nuclear plant has to pay a certain amount yearly into a fund for its eventual decommissioning. (The same sort of situation applies to insurance, in case anybody was wondering.)
It's weird and may relate to different Things being measured, but UK decommissioning seems to be vastly more expensive than US decommissioning. Judging by news coverage anyway.
Edited for spelling.
If more of our electricity came from nuclear, load-following would become more of a design priority. Or we would build some highly adjustable loads that can take a bunch of excess power when it's there, like aluminum smelting or electric car charging.