I meant more along the lines of the office in general tolerating your beliefs, but if you share an office with him, that might be more of a concern.

And fair enough; your situation is your own, and you know it better than the rest of us.