We built Hitlist (hitlistapp.com) to make this accessible to laypeople - I used to do the same thing you mention, scraping specific routes I knew I was going to fly. It's far from perfect but makes it easier to browse lots of date/destination options at a time.