Yeah but I really doubt they're using latency discrepancy as a signal. I can think of plenty of ways poor latency could come up on their verification requests but not affect the normal Googlebot requests. Also that's not really something any black hat SEO would involve so Google doesn't really have an incentive to look for that in the first place.