It's still an issue for the road owner, which will generally be a town. The town pays for that road surface, with the expectation that it will be mostly used by those with some other purpose for being in the town.

It's a bit like the complaints about Waze sending cars down minor little suburban streets. The town hadn't intended to be paying for the transportation infrastructure of a nearby major city.