If the two speakers were any closer to each other than say 80 feet or 25m (which is roughly how far sound travels in 0.1 second), I wouldn't expect you to have heard the effect I'm describing. There would have to be enough distance between the "source" and the "canceller" to throw off the timing.