Yep, those are the ones. I roll one into a ball then push it in.

The silicone deforms to the shape of your [outer-ish] ear canal, and is a bit tacky which helps create a better seal and maintain it through the night. Cheap and worth a shot.