It really is. Every physicist has a dozen ideas like that they realize are stupid, have no evidence for and can't really be proven or disproven with current data.

We call them crazy to keep our selves from going off the deep end and talking about ufos, the foundations of mathematics or the genetic differences between races.