Search for the Thomas Lubanga and Mr Jean-Pierre Bemba Gombo cases. The ICC can issue 'sealed' (secret) warrants and tell the countries very late in the process.

Yeah, in practice any such warrant will eventually leak, but it's still a risk for anyone who might be on the other end which de facto creates limits to anyone who might fall under suspicion.