NYT also created a similar experience using video where video.currentTime was tied to scroll location: https://www.nytimes.com/interactive/2019/10/30/world/middlee...
I think there are some restrictions on video encoding parameters in order to make scrolling feel smooth which will increase the video size.
Surprisingly, yes, the video is exported as a sequence of JPEGs: https://jsbin.com/wodusuzeja/1/edit?js,output
As for the tool, ffmpeg seems to work well enough.
Also what is a recommended tool of 2019 to convert video to images ?