I was/am working on similar tech, and there are dozens of cuts when you cover every possible edit and release format (VHS, Betamax, Laserdisc, DVD, Blu-ray, streaming) and even the problems of 24/25/"30"fps causing creep.

It's solvable, it just requires more tagging and more data.