It sounds like the circuit was biased toward exploit more than explore. Ideally, a spatial-temporal variant of Thompson sampling would be used to inform where and when to scout.