Who cares if dirt gets in? You have to clean anyways right? Is dirt more powerful outside than inside? Dirt in the air doesn't matter? If your shoe has excessive dirt, you can wipe it on a matt as you ener right?

Also, not changing socks means now random people leave feet sweat and nastiness all over the house floor.