Definitely not (except for the most egregious cases), long-term construction sites in Japan are already fully covered by white panels that don't even let you see inside and short-term ones have at least two barriers and lots of signals. While them not being there does not mark "dangerous", I do think them being there could mark them as "extra-safe".