I think a "my direction up" would work better if the compass direction is displayed on top of the screen, like on video game/military aircraft HUDs https://eu2.contabostorage.com/2baf1d556e44458999c03b1595ea0... , or since the directions are around the "you are here" marker, the N/E/S/W markers (and its subdivisions) could be placed on the 4 edges the screen, and would move around as the phone changes its heading.
Someone else said elsewhere on this comment section, if only a navigation app would also show the position of the sun at that moment. If we already have the compass directions, the direction of the sun can be an extra UI element.
If I asked you to draw a map of the room you’re in, I highly doubt you’d orient the straight angles of the walls with respect to the angle of your body. You’d draw them along a compass rose relative to the structure. Rotating a map to your gaze is actually not very intuitive when your goal is to usually to transform the world to be outside of your reference frame.
The transformation of the map into your perspective is a last-mile problem: it’s important when you reduce your decisions to “what landmark is in front of me, and what is to my left and right?”