I have a small eval set that I rerun every week with my own tasks. That's the only way I've found so far to distinguish between model changes and having a bad day.