Recumbent bicycles are older than the modern "safety" bicycle. They lost in the marketplace on their own merits long before the UCI even existed. They are faster in some scenarios, they are slower in others. They cost more, they weigh more, they break more, they're less agile.
The '30s were not the "dawn of racing." The peak of bicycle racing (and technological progress) was 1880-1917. That would be when the safety bicycle was emerging as the dominant configuration.
Moulton wheels had over 30 years to prove themselves before they were banned in 1996, following the Lugano Charter. They didn't.
And surely you realize that all of your claims (cost, weight, breaking, agility) can be more easily ascribed to the fact that uprights are a huge mass market with enormous R&D funding, and recumbents are a tiny little hobbyist thing. Okay, maybe not agility, that's probably inherent.
I agree, however, that the UCI seems to selectively make their equipment rules. At they've given up the disc brake fight in cyclocross, though some early returns show in certain conditions, rim brakes are still better.
The UCI has been hypocritical, inconsistent, and mendacious in its claims here.
At the dawn of racing the UCI banned the recumbent Velocar not because it was so much faster (it was), but because the powerful (ahem) upright bicycle lobby demanded it.
The there was the Moulton, which started winning lots of races on its 17" tires in the 1960s. The UCI notionally banned it for nonsensical "safety" reasons, while it was really about small wheels being too fast. The big-wheel bike manufacturers had gotten scared.
Meanwhile, while the UCI was busy banning minor things like beam bikes, disc brakes, and even different rider positions (!), it was perfectly happy to allow huge changes in materials (carbon fiber notably), pedals, and wheels.
And then there's the UCI largely ignoring and wrist-slapping the biggest technological improvement by far: performance enhancing drugs.
So if you don't mind, allow me to be annoyed that the UCI has destroyed the small-wheel and recumbent market in the name of consistency, while being largely complicit in the biggest sports drug scandal in history.