For an easier change than HTML or SVG, try running them though pngcrush to make the graph images much smaller. Won't give you the lossless vector quality, but you should be able to keep these image files visually indistinguishable at much lower size.

Lesson learned for real, and TIL matplotlib is happy to export SVG. Good to know for next time. I upgraded my lightsail instance size in the meantime.