Depends upon the service and how the harness is built, Some of the services allow for very few cache keys, so you won't necessarily get any cache if you edit recent messages as the cache is not per message, but big blocks of everything up to a cache key.

This was actually surprising to me when I learned about it as I have never worked with (or built) any cache working like that before.