> and I'm sure with some tweaking of compression options you could make a .mp4 video with higher quality and a fraction of the size of the equivalent .gif.

No tweaking needed. Test it yourself: Download any of those huge gifs and encode it to h.264 with ffmpeg defaults. With no perceptive quality loss it's immediately 60-90% smaller. And then h.265 comes along soon.