Just pulling on my reply to same, varying your tax on a person's earnings is a much better way of means testing life than by separately means testing every tax.
But what's wrong with that? We all pay for national defence. We all pay for nationally funded arts and schooling and science. Even people without children or cancer or an interest in weird concept dance. We pay for this stuff because it makes our countries better, as a whole. Infrastructure is no different.
Even ignoring that, how do you issue this welfare to people who are paying this/these road use tax? Tax them less at the pump or the tolls? Who implements this?
And that still isn't fair. They're not paying for the roads they use. This money goes nationwide. Or does Tincanville (pop 30) have to shoulder the cost of their entire road network now?
Unless you're willing to take this to the absolute bureaucratic extreme, and make some people pay tons for low-use roads (which age naturally, regardless of use) an indirect tax of some description is the only way to keep the entire road network viable.
Since this often comes up as a criticism of policies that eliminate subsidies, I want to emphasize your point that there are simple ways to counterbalance such a harm.
The easiest is you shave off some tax revenue from the wealthiest users/residents and redistribute exactly the amount back to the poor they would need to purchase the good as no-strings-attached cash. This makes poor people who choose to use the previously-subsidized good no worse off than before, but frees up those who never wanted to use it to find a different use of that money (e.g. public transit, or moving closer and paying higher rent but paying less in transportation).