It absolutely should only take a couple of frames to make a video fullscreen, but to put things into perspective, on my 2015 macbook it takes 3-4 seconds to toggle fullscreen on youtube, and my much more powerful linux desktop isn't much faster.