It is always a balance with risk management. People should wear heavy duty motorcycle gear and a helmet when riding motorbikes, but with cars the same gear is seen as a bit excessive as there are a 30x difference in risk for the two mode of transportation (per distance traveled) and the small but possible risk of a false sense of security might result in worse driver behavior.

If you are near someone in a risk group it seems very good advice to use or even mandate the usage of masks. Same for being around high risk areas such as using any mass transportation. For low risk areas the benefits are less clear and the potential downsides seems to have about as much evidence as the benefits.