The reference price is then their competition, and since prices are not obfuscated you can compare 1:1.

Just like now, but dealerships add a whole layer you have to figure out by determining likely "discounts" between different brand's dealerships.

If the manufacturer could charge more they'd already be doing so, the dealership doesn't actually dictate the prices, they get told the price and are expected to negotiate up then keep the difference.