If you get the old foam slip-on covers that used to come with all Apple headphones, they might stay in your ears a little better, and you can close the case over them.