If been thinking about doing just this for a bit now. I plan on showing thumbnails plus a QR code for animations and videos; I have yet to figure out how to make the files accessible in a private and durable manner though.

Maybe you could use something like GPT 4 vision To include a text description of the image in the transcript

Filtering full-color images down to a halftone suitable for book publishing is a mature technology, setting up an ImageMagick pipeline to do so would not be among the hard parts of preparing a book like this. Picking the right still frame out of gifs and video is a bit trickier, but not by much.