In a simple world you'd just slow it back down to 1x when you get to this point, and you wouldn't need 2x, you could just skip forwards 10 seconds at a time like most people until you find it.
Unfortunately there tends to be fillers throughout the video, even inside of the sentences people speak. The real lifehack is to keep the high speed and then pause when the video said something important, so you can digest what you just heard, and resume - rinse and repeat.
A variant solution I prefer is to always be regulating the speed according to the load on your attention span. Videos change so much in info density from one minute to the next, it's nothing short of strange to watch at one set speed throughout. I think the fact it's so common to "give up" and "accept" a given video speed is an artifact of the fact that people have never had the experience of letting their subconscious finely control the speed with muscle-memory. Doing it keeps your attention at 100% usage all the time. Low info density, high speed. High info density, low speed. Use a browser addon that gives you hotkey control over the speed, or use ff2mpv to exploit mpv's native speed controls.
I am honestly a bit frustrated with how much information is getting locked up in videos as I find them a pretty poor format in comparison to text annotated with diagrams.
I don't know if anyone else is like this but inefficiencies tend to bug me. This is purely personal preference but folks who talk slow or use a lot of filler words can ruin a video for me to the point where I'm focusing on that instead of the material.
I tend to listen to everything at 2x (instructional videos, podcasts, etc.) and I don't really see any downsides even if it's only watched once. If it's something deep or you're following along with code then you'll be pausing the video no matter what speed you listen to it to apply what you're watching. When you factor all of that together you can IMO absorb things just as well as 1x.