It's the same difficulty as any other MITM - if you control a point in the routing chain, or if you can affect the routing chain through e.g. BGP, you can do it.

The crawls will probably originate from random AWS addresses, but you can target by User-Agent, since they identify themselves there.