It's probably a good idea unless you're OK with your opinion appearing uninformed. In general, an opinion is not some magical thing which is exempt from evaluation. "IMO the Earth is flat" may be qualified as an opinion, but it would probably lessen your opinion of the speaker just the same.
^^ First sentence of the article.
You don't need to cite references to give a counter _opinion_