A separate signal is user leaving SERP, going back to it and checking another site - somewhat clear sign of failure of a site to deliver. And users leave if your page loads slowly.