Cargo or not you probably should do that for your container, or use a shared cache (which I do at work for both Cargo and pip) ;-)