Usually a taxi/lyft/uber has the doors locked and if someone tried to open them the driver would drive away.

In this situation of yours it sounds like anyone can just walk up to a AV and open the door and get in.