From what I understand, on ferries (and similar "two-sided" working boats), port and starboard get switched around when the boat changes direction of travel, usually when docked (and its navigation lights also turn from green to red and vice-versa).
Edit: I found more discussion on this by searching for "double ended" boats. Port/starboard do indeed change depending on the direction of travel from all results I've found.
The car decks and the sundeck appear to be mostly symmetric other than labelling, and maybe elevator placement? The machinery under the car decks is likely somewhat assymetric too, but I've never gotten to go down below.
To be fair, they may not be 100% symmetrical. I am not measuring. They are close enough that I can't imagine it would be a good use of the terms. (That is, when the VAST majority of the time the bow is the front of the boat, having a few bigger boats where I have to inspect it to know which is bow and stern would be a bad idea.)
The ferry is actually a very odd boat in this, btw. As I am not clear that starboard/port are fixed. The boat literally goes in both directions, such that I'm assuming I don't have to know which is the "front" of it irrespective of the direction it is currently traveling.
I get your point, that things can be difficult. And I appreciate having jargon that is specific for an attempt to make things clearer. I just find this as the sole explanation kind of unsatisfactory. Seeing the history of the terms makes a lot more sense.