ffmpeg can operate in on streams of frames, you don't have to keep everything in memory or operate on discrete batches.