"Refusal on the ground of freedom of thought" is enough to convey exactly the same without loss of meaning. No need to mention religion, no need for religion-specific exemptions.