Every time I try to build a castle in my swamp, it gets to a certain height and then it just sinks?

STOP telling me about civil engineering, we fucking invented that shit. And NO, we have to build it in the swamp, it feeds us and keeps us safe, and I'm darned proud to say we invented that too.