My guess is that a lot of people do interior work without permits. If you're tearing down an interior wall and re-building a bathroom, there's no evidence of that from outside, so no simple way for the city to stop you.