I'm not sure how common this is but I know Lake Michigan goes through an annual cycle where the water alternately mixes and segregates (by temperature). In the summer, the warm, less dense water rises to the top and stays there. In the winter, very cold water is actually lighter than slightly warmer water and a similar stratification happens. In spring and autumn the water temperatures near the surface equalize with water deeper in the lake and much if not all of the lake water circulates ("turns over").
"The low compressibility of water means that even in the deep oceans at 4 km depth, where pressures are 40 MPa, there is only a 1.8% decrease in volume."
also: http://en.wikipedia.org/wiki/Oil_platform#Deepest_oil_platfo...
either way it doesn't matter for this argument. we're talking about the difference between water and whatever it's replaced with such as "nothing" or something cheap and abundant with similar properties.
also, the water we're talking about is not itself 4 km deep. it may be under 4km of sea water, but the fresh water under the seafloor may be only 500m deep with an equivalent pressure of 4 - 4.5 km.