Have you tried having a conversation with your employer? If they view it as a negative maybe you could forego your next salary increase and ask for maybe two work-at-home days per week or something similar.

PS: Where did you first learn of the expression "code smell"? I'm curious because I recently heard of it and would like to know if it was from the same source