As a Dawkins-thumping atheist, I don't think I would mind too much. 'Houses of worship' happen to have some be the most beautifully architectured buildings so naturally make for good venues, irrespective of your religious beliefs or lack thereof.

I do however doubt that any house of worship really wants me in it.