Usually if/when you identify a spy from an allied country, you just try to keep really close tabs on them and otherwise let them go about their business. If they start crossing some boundaries, then you quietly and firmly let them know it's time to fuck off.

You don't publicly expel them unless you really want to weaken the alliance, and you certainly don't torture them like some of the commenters in this thread are suggesting. They watch too many movies.