I think the cars picking up things/people without drivers could be the worst part. Imagine being driven in a taxi, and about half of the vehicles around you have nobody in them. I suppose it's not inherently wasteful since you never really needed to be in the car to go pick something up. However, if the price of delivering something by car decreases a lot, the volume of deliveries will increase a lot too.