Most of the time if there’s obvious plaque growing on your teeth, it’s because you were eating something sugary immediately beforehand.
In my anecdotal experience, halitosis is also diet related, and brushing teeth has only very short term effect on it. Most of the time, bad breath is neutralized better and for longer by just eating a meal than by brushing teeth.
However, other people notice even subtle differences/inadequacies in one's hygiene.
As professional advice, I strongly caution against not brushing your teeth, or at least, telling others that you do not brush your teeth in public.
It's a shame downvote has become an "I disagree with you" button instead of a way of signalling "low quality content." I counter-upvoted you, which also abuses the downvote button, but at least two wrongs somewhat make a right here.
Aristotle: "It is the mark of an educated mind to be able to entertain a thought without accepting it."
There are real social consequences in American culture caused by not brushing your teeth. Other people will get offended by your bad breath and yellow teeth (especially those of the opposite sex).
It might be a "weird" ritual, but it's also part of our culture and how people judge you (which actually does matter a lot in society).
Similar arguments apply to things like not bathing and drinking soylent.