Could it be that they are aggressive not because of the context switch but the fact that you are forcing it on them? I know I sure as hell hated when my parents told me to stop playing video games but had no problem quitting while I was in the middle of playing if something more interesting was happening like my friends showing up at my house.