I can't remember if we ever did this, but the solution seems straightforward, just start an upgrade container that has both versions.

We definitely did not use the container that's in the locker library though. Ours did some custom checks on startup.