I don't see that bug on Firefox (version 88, linux amd64). It slides out as I scoll down and stays hidden when I stop scrolling. It only comes back into view when I scroll up.

edit: Are you scrolling with a janky mouse wheel or multi-touch trackpad that might be triggering up events accidentally? It looks like your page jerks up a teeny bit from momentum when you stop--that's probably the issue.