Don't beat yourself up about Z. The Z axis is both a convention and commonly used for height in many fields, such as civil engineering, vehicles, and geology. All areas where the horizontal ground is important. It's computer graphics with its vertical screens that mainly has Z for depth.

There does seem to be an underlying commonality to these conventions which might be that Z is normal to some important reference plane, the direction without homogeneity, or the most unique direction.