That's basically my lay-person's understanding also. It's because the expansion isn't significant at small scales, so gravity and electromagnetism overpower it. This causes existing objects and clouds to effectively remain the same size [I have to assume that there's an effect, stealing potential energy at very small scales].