There are plenty of people who don't want to interact with anyone when making a purchase (me included), and you are losing that business, even if it is only a small part.