In any case, I changed the example from 30 to 10 tosses, so that we avoid "missing the forest for the trees".
No, you would walk away, despite your superior knowledge of probability. But let's say that it was only 10 flips in a row, as in your modified example. Would you stay and bet? If you would, perhaps it is you is is missing the forest. :)
More precisely, perhaps the problem is not their knowledge of probability, but the difficulty of modeling the real world with standard probability theory. The Bayesian approach above at least allows for the possibility that the coin is not fair. How does your model allow for this?
Mathematicians have to be able to specify priors. Insisting they are unrealistic rather misses the point that the entire reason the phrase "fair coin" appears in the first place is an explicit acknowledgment of the unreality of the situation.
If you want to more rapidly move to a Bayesian system when teaching, I'd understand completely, but we still have to start with "fair coins" before we can get around to considering how to prove they aren't fair. (I will be first in line to say many school teachers, being generally poorly trained in mathematics, completely fail to understand this point, and correspondingly ask the "gotcha" question about "what's after 29 heads?" without fully understanding the issue themselves.)
Suppose there are 1 billion coins in circulation, 100 of which are double sided [1] (due to magicians accidentally spending them, etc). Then:
P(double sided) = 10^{-7}.
P(30 heads in a row) = 10^{-7} + (1-10^{-7}) x 9.31 x 10^{-10} ~= 10^{-7}
P(double sided | 30 heads in a row) = P(30 heads in a row | double sided) x P(double sided) / P(30 heads in a row) = 1 x 10^{-7}/ 10^{-7} = 1
(Via Bayes rule.) So the coin is probably double sided and the gambler is right. The mathematician who lacks common sense is wrong.