I think it's a valid opinion. Weather changes suddenly. While "never" may be a bit too absolute, I think it's wise to prefer an IFR qualified pilot when one is available.

"Especially coming from someone the HN crowd."

I think you're venturing into No True Scotsman territory with that statement. The "HN crowd" is pretty diverse.