They own the house, not the right of way in front of it.
People who think they own the road are why we need self driving cars.
I'm very eager to get to the point where we have self driving cars, even though I'd be categorized as an enthusiastic driver (daily driver is a h-pattern 5-speed, racing experience including championship wins, etc.).
That said, if they were beta-testing in my neighborhood and actually hurt my kid or likely even a neighbors, they'd have a hard time keeping their cars running in the area.
"Move fast and break things" is only valid in a few limited contexts, and is particularly invalid in any potentially fatal context. I understand the need for realistic data, but, their industry has already killed someone beta testing (yes Uber. not Google, but...)
I would be angry, too. The prospect of self-driving cars excites me, but I can totally understand not wanting your neighborhood to become the testing grounds for this new tech. Uber and Tesla's mishaps in the self-driving space understandably color the public's perception of Waymo's far more responsible efforts to date.