This was something I had to find out the hard way in the process of writing this

https://github.com/thearn/webcam-pulse-detector

Without interpolative resampling, it didn't work well for me at all.