I suspect that even a spare cotton t-shirt material affixed over the face would stop a significant amount of droplets from transmitting.
It would be worth researching the effectiveness improvised masks, at the very least.
If the mask becomes contaminated, it becomes an ideal vector for encouraging infection -- so if you touch the inside of the mask with your contaminated hands (say you move the mask to touch your face or adjust it or whatever), for example, the mask becomes the opposite of protective.
Masks are somewhat effective at reducing spread if the already-infected person is wearing the mask.
Also my understanding is that a N95 mask that isn't properly worn (doesn't have a good seal) then it's nearly equivalent to no mask at all.
So you combine those two together and you have people who aren't effectively protected by the mask and are making riskier decisions.
--
I have looked at a fair bit of research on masks lately, and everything I've seen is that they are significantly protective, and, for example, reduce your risk of catching SARS by about 70%.
Yes, if a mask doesn't fit properly, some air will come through the sides. Even in that case though, the mask is still filtering some air, and it's protecting you from touching your mouth or nose, and it's protecting you from droplets hitting your mouth or nose from being coughed or sneezed on.
Surgical masks are meant to protect surgery patients from the medical staff and the droplet-encased germs they emanate. N95 masks are meant to protect the wearer from particulate matter (harmful dust) in the air, specifically those particles over 30 microns. SARS-CoV02 is roughly half the size, so as an aerosolized virion, as opposed to droplet-suspended virions, they may have limited effect. N95 masks also often come with exhalation valve releases to improve inhalation fit - so exhalation pressure does not break the seal around the sides. A sick person wearing a mask with a valve that releases right in front of their mouth may be better than no mask, but it is a potential bypass for droplet suspended virions.
The US just doesn't have the culture where everyone puts on masks during flu season, like some places (HK for one), and that level of herd usage is really what might be likely to slow transmission to a breakable rate.
The N95 filters are tested with particles at 30 microns, but that doesn't say anything about their effectiveness against other particles.
3M, naturally, has released some information on this exact topic [1] which goes into a fair bit of detail on the various methods by which masks effect filtration. The tl;dr version is that there are several ways by which filtration is achieved that generally overlap and work towards providing effective protection well above and below 30um. There is generally a small dip in the transition between two primary methods which creates a specific size range where filtration is less effective.
Whether that's an issue depends on your definition of "limited effect". For the masks they tested, that dip generally occurred around 0.04-0.1um. Even in the worst case scenario, however, the worst masks tested were still filtering ~94% of the particles (in a mask that only claims 95% effectiveness to begin with). The linked document has coronaviruses listed as being about 0.125um in size, which has them falling toward the end of the dip where the mask is trending back towards 100% efficacy.
(For what it's worth, they also have the distribution of droplet sizes in a sneeze and they are all smaller than 30um as well. However they're still in a range where the mask will be about 100% effective.)
Which is all to say I certainly wouldn't describe an N95 mask as being of "limited effect".
[1] https://multimedia.3m.com/mws/media/409903O/respiratory-prot...