Flux can be hazardous too, even if your solder is lead-free.

But in a non-occupational exposure setting you're not likely to have issues if you solder occasionally even with lead solder and don't take any precautions.