Yeah, that's a definite issue I've had in dealing with mine. Fortunately, they're easy to swap in/out and are mostly affordable to buy new ones ($11 for a two pack on amazon right now).

I have one I use for the chilis, bbq, ribs, etc I do. One for soups and such, etc. It's a slight pain I guess, but the ease of use of the Instant Pot in general outweighs swapping out the silicone seal occasionally.