News for hackers. Stuff that matters.
Re:Hedge-fund managers that do the most research will post t... by otoburb on Thursday March 22, 2018 @11:37AM (#16649521)
Did they scrape indiscriminately, or did they pay for access? I'm hoping it was the latter so you were able to keep the site self-sustaining for a while longer.
Re:Hedge-fund managers that do the most research will post t... by wgerard on Thursday March 22, 2018 @11:43AM (#16649574)
The info was gated behind a paid login, so thankfully we didn't have to worry too much about scrapers. We also set up a notification system when new campaigns came out, so they didn't have to long poll for new info.

We actually did have quite a few people scraping our homepage for some reason (which was rarely, if ever, updated) but they were mostly other aggregators as well, not potential clients.