The part I touch to lower is the top of the lid, so relatively distant. But the part I touch to raise is the underside of the lid, at the edge. While it might not be in the most direct line-of-fire, I would expect it would actually get a decent amount of particles because it is adjacent to an air gap, where pressure would escape. But I'm no aerodynamicist — just speculating!
Why would you touch the underside of the lid to raise the it? You can't even reach the underside properly before you've opened the lid.
In any case, just use a piece of toilet paper to touch the lid, if you are concerned.
The parts of the lid that you touch to raise and lower it are probably relatively distant from the parts of the lid that would receive the brunt of any splashback.