The tyranny of the rocket equation. Or simply put you don't have to carry fuel to carry fuel to carry fuel to get you to the bottom of the ocean. Simply carrying some ballast will do just fine.

The pressure hull isn't the major engineering challenge in getting to space.