So if you ever get flung back in time, probably your best best is evaporated sea salt. Then work your way up into simple cosmetics. You don't have the ability to create the supply chain necessary to create canning.
http://www.ancient.eu/article/592/
So, they would have been able to produce glass jars alright and would have probably used (like it was done for wine and amphorae ) "sealing wax" together with cork (and/or some resins):
https://vinepair.com/wine-blog/history-wine-transport-8000-y...
And BTW, they were quite good at making airtight cans, too:
https://www.theguardian.com/uk/2003/jul/28/artsnews.london
(though most probably it would have been far too expensive to mass produce them at the time).
Even if they had rubber in enough quantity, they'd have to vulcanize [2] it to make it work. That was years, centuries beyond them.
1 - https://en.wikipedia.org/wiki/Natural_rubber 2 - https://en.wikipedia.org/wiki/Vulcanization Edited for the vulcanization.
Edited to add, and the jar too.
The Ball Perfect Mason Jar was introduced in 1913 with a bead for the seal to rest upon. That would have been under patent and expensive in the 20s. So the tech (barely) existed to vacuum seal pressure cooked canned food in the 20s but it would have been patented and too expensive compared to cheaper cans.
https://en.wikipedia.org/wiki/Mason_jar