Even if it was precisely the same configuration of zips/pockets/etc. there's still the fact that a female cut garment can need to have different amounts of material to accommodate bust and hips.

I accidentally bought a women's cut top at a goth festival once; the extra material across the chest was noticeable when wearing it (though other people didn't notice from just looking, so I happily wore that top for years anyway).