I have a feeling that if you articulated your case well enough the prof would have eventually dropped the issue.
I have to say, this seems like it’s mostly on you not defending yourself. Sure the professor was wrong and being an ignorant ass but you shouldn’t have rolled over like that.
There was also a bit of math towards the end that I was a bit shaky on... but again, the examples in class really made it clear. I can't say I remember too much about Optics, but the rudimentary Complex Analysis in the course gave me the confidence to take other courses that used "difficult" math.
As a high-school Valedictorian, I too was set up to do very well in academia, but could tell it would be too hostile and backwards from what I wanted. You're expected to be way too submissive and highly discouraged from original/independent/unpopular thought that conflicts with those already invested. I was excited to get to "real education" after conforming to high school but the rules only tighten, and it's 100x hyper-political.
So I skipped it, self-taught, and started stacking money. No use in casting pearls before swine and try to "fix the system" (and likely just be sacrificed to it, like Semmelweis). To the people trying to fix problems, thank you for choosing to be the martyrs so I don't have to; on the other hand, Max Planck had the right attitude when he said things advance via funerals, so why let it be your funeral?
Academics are good for bagging my groceries and delivering my pizza though, so I am grateful for their contributions. (I'm dunking on them here in jest, but PhDs -- pizza handling and delivery -- are above midwits but just often grossly misapply efforts. Sad to see).
I am sad to say my junior year honors literature course had the most impact on my career. One of the assignments was an analysis of one or two Matthew Arnold works (Matthew Arnold's a 19th century poet & critic who's pretty well known in academia.) He's not my favourite, but not horrible by any means. I'm more of a Browning or Houseman fan, really. But in academia you study more than just the stuff you like.
Turns out my prof was a guy who was REALLY INTO ARNOLD.
I write a paper and pull some argument out of my ass; can't even remember it now. My paper came back with an F. Not because I pulled the argument out of my ass, but because it was the same argument made in an obscure journal by an obscure academic. My prof demanded to know a) why I didn't properly cite this obscure academic and b) where I had found a copy of the journal article. He apparently had the last printed copy in Texas and it was starting to deteriorate. It wasn't in our school's library, so where could I have possibly found the article? (this was before everything was on the intarwebs.)
I tried to explain I had simply pulled the argument out of my ass, and that it seemed reasonable. His counter was there was no way a mere undergraduate could have produced such a sophisticated critique of Matthew Arnold.
So I got an F on that paper and every paper I turned in afterwards. Sadly, it was past the point I could drop the course, so I wound up with an F. I dropped out of the honors program and eventually left that university.
I still pursued natural language research and still love the intersection of semantics and syntax. Fascinated by Sapir-Whorf, think Chomsky's a first class mind, &c &c
Before that class, there was a non-zero chance I would have pursued a PhD in literary criticism. Afterwards? No. F that and F academia. I still write, but not as a career. And I still enjoy reading both high-brow literature and low-brow genre. And the cool thing now is I pretty much read what I want to. I don't have a stack of "serious" books I have to read. I don't have to read everything Doris Lessig wrote. I can read another Saul Bellow novel and not feel guilty (though obviously, I'd feel pretty depressed afterwards.)
So... that one class definitely dissuaded me from a life in academia. I'm out in the real world banking coin and doing what I want.
Now... please feel free to down-vote me because I criticized academia and had the temerity to suggest I was capable of independently constructing a reasonable critique of a 19th century poet.