... and yet every single hit on the first page of a Google Images search for "Swiss cheese" is of a firm, yellow cheese with large holes.

I completely accept the premise that there are many different kinds of cheese made in Switzerland, however it also seems pretty clear that the kind with holes is the one that has achieved a critical mass of global mindshare.