Job searching with "stranger" companies becomes harder.

But if you leave enough coworkers who want to work with you again at each job, you can always find jobs through them.