Both of them. Where I live, in a mountain region in France, temporary restrictions are put in place during a handful of days between the last winter cold and the first spring sun: heavy vehicles are forbidden to go over smaller roads, as the ongoing defrosting is a weakening factor and not every road is as though as a motorway.
The difference is night and day when going between my hometown in Montana and a similarly sized city in Iowa. Our asphalt roads are well kept and maintained, but the roads in Iowa are a buckled nightmare.
On the other hand, the passenger lanes on freeways (where long-haul trucks generally cruise) sure wear out faster. I think it's more that freeze/thaw and snow plows exacerbate and accelerate ongoing wear and tear.
So obviously heavy things can do damage.. but roads do wear out even if they just sit.
I'm not sure which lanes you mean by that. Or did you mean to say "passing lanes"?
In this case the road I am thinking of is almost a highway (4 lanes, wide median, fast speed limit).. and the short dead end roads were built to connect to another busy road - but never finished. Sort of ended up as 20 feet of highway and then a grass field. So in this case, the assumption is that the road was built to the same spec (and on the surface it appears identical).
There are roads I know of that almost never see a car (say a few a month, weird dead-end roads).. and they wear down just as fast as main streets.