I don't think that's true. Most people are accustomed to there being many "recalls" for trifling matters which can be simply ignored until maybe the next time they bring the car into the shop. A typical conversation about recalls:

> "I changed your oil, and I also replaced one of your door seals because there was a recall for the rubber cracking in cold weather"

> "Oh, okay."

It doesn't colloquially imply that the manufacturer is going to come take your car due to some major issue.