Yes, of course you remove and trash gloves to avoid contamination. I did biochemistry for years. We wore gloves to protect proteins in samples from our proteases, and to protect ourselves from radionuclides. When I labeled stuff with mCi levels of I-125, I worked in a fume hood, behind lead bricks, wearing a lead apron, and three layers of PVC gloves.

But I always tossed the gloves before leaving the work area. And usually I'd put on fresh gloves before removing the lead apron.

That wouldn't be workable day to day. You'd probably go through 50-100 gloves per day, doing it right.

I worked in biotech manufacturing with biohazards. 50-100 gloves/person/10hr day is about right.

Presumably that doesn't mean people forgo gloves in the lab though, right? The point is you get them dirty, and then you take them off.

You don't just "take them off". You carefully pull them off, inside out. And then dispose of them, as hazardous waste.