Have your phone camera pointing at the road as you drive, uploading shots to Mapillary. Mapillary will automatically detect signs from the photos. In JOSM you can toggle an imagery layer of those detected signs. This is how speed limits, stop/give-way signs, maxweight and other details have been mapped in many regions.

Start with one, that already makes the map better.