I think that joke is told about literally every either ugly or retro famous building/landmark in the world.

If it's not referring to the best view, it's always where some famous architect claimed to stay when they visited, in order not to see the building from their window.