so how do you make it right, just bull doze it?

Find someone with a suitably bottomless supply of money who wants it as the status symbol it always was. Or somehow make it nice enough to be a public attraction, but there's a real oversupply of chateaux.