As an American, I think of nothing when people wear hijab or whatever, and trust me, I am an atheist who think religion is irrational and that humanity would be better off without it.
Maybe the French would be better off thinking nothing of it when someone wears religious clothing, just as we are starting to think nothing of it when people are gay or transgender or whatever.
I see it as clearly unnecessary/voluntary (so it's quite different from being gay like in your example), so it's an attempt to advertise, which leaves a bad taste in a place like a school.
You'd get a bit of flack if you wore a conservative shirt in an extremely liberal environment and vice versa.
Still, if you'd want to put up legal barriers to displays of religion, you'd certainly need to find better reasons than "it makes people seem very arrogant" ;)
Schools, being places of science, might mandate non-religious clothing in the same way monasteries and temples should be free to set clothing regulation inside their premises.
But prohibiting the wearing of religious clothing IS pushing political views.
I guess Americans would take offense to this view, but I find wearing religious clothing in a public institution such as a school incredibly obnoxious and pushy -- it's akin to your professor suddenly starting to push his/her political views onto you in an unrelated lecture, or something.
It's not that it's bad to wear religious clothing or have political opinions -- it's just that a school should be a place of learning, not propaganda.