> Is anyone building fission reactors, or any kind of huge concrete building out in the ocean at all?

Yes, they are and it is a huge political issue in nearby countries.

https://en.wikipedia.org/wiki/Russian_floating_nuclear_power...