There's a good reason for lack of sharing as both Aldrich Ames (CIA) and Robert Hanssen (FBI) ended up providing much more sensitive information to the adversary than their rank qualified them for.

The agencies seem to be on the cycle of high compartmentalization -> criticism for lack of sharing -> low compartmentalization -> major spy scandal -> high compartmentalization.

Those guys committed treason by sharing with the Soviets. I don't see how that's relevant. The reason for the wall is because they have conflicting mandates.

The natural response of each agency to prevent such massive information losses in the future is to limit the amount of information available, make it accessible only on the need-to-know basis, and introduce bureaucracy into the information retrieval process by keeping the logs and requiring sign-offs.