It's the flux in solder fumes that are toxic, you shouldn't be vaporising the lead. A well ventilated room and a small fan to blow across your work area should be enough for most hobby work.

That being said, you should wash your hands after dealing with leaded solder and consider some disposable gloves if you're going to be doing a long session.