If it is dark and there's traffic it is safer and useful for everyone to be visible. Obviously this depends on how well the streets are lit, if they are very well lit it may not be a big issue.
As a pedestrian at night (which is pretty much any commute to/from work in winter in the UK) I know that sometimes cars don't see me or see me at the last moment if I wear dark clothes, or even any clothes that are not high-viz.
And as a driver I know that this is because pedestrians, or even cyclists at crossings, can be very difficult to see in low light conditions (good forbid there's fog as well!) even if you're driving carefully.
This is all common sense, really.
In my neighbourhood, which is residential and poorly lit as many are here in the UK, people also wear lights on themselves when they walk their dogs in the evening, and they usually also make the dogs wear lights.
When I go running in the evening I wear a high-viz jacket and one of those chest lights so that I can be seen and can see the potholes as well.
Again, common sense for safety in such conditions.
The only infrastructure issue is the level of lighting. However with the trend of fighting light pollution and of saving energy street lighting is not exactly getting brighter here... I know a nearby village that does not even have any and that is really dangerous when people cross the road to go to the pub (or to leave the pub, hmm...) completely oblivious of their surroundings.
For instance, in many cases, when a car has injured a cyclist severely, there could have been infrastructure to prevent this (e.g. separate bike lanes, clear road layouts, …). A helmet would not have prevented the accident.
Similarly, unless someone's crossing a dark street at night without looking for oncoming traffic, why should pedestrians have to be wearing reflective gear all the time, when there could be well-illuminated crosswalks, slower driving speeds, speed bumps etc.?
(I'm not claiming there aren't cyclists ignoring red lights or pedestrians randomly crossing roads in unsafe situations … that's usually the next argument.)