News for hackers. Stuff that matters.
Re:Search all Craigslist cities for a remote job by point78 on Monday April 08, 2019 @07:57PM (#19610355)
Craigslist will send you a take down notice in a week, this is explicitly against their terms. I'd advise taking it down before a lawsuit.
Re:Search all Craigslist cities for a remote job by ravenstine on Monday April 08, 2019 @08:54PM (#19610640)
That's basically what happened to Padmapper, sadly.

With the amount of scams causing a decline of their platform, I'd think that Craigslist would want other sources of traffic. I know that most sites have a policy against scraping/indexing, but Craigslist has their head up their own ass.

Re:Search all Craigslist cities for a remote job by rdiddly on Tuesday April 09, 2019 @03:01AM (#19612434)
I feel like anybody who quibbles about scraping has their head up there. It's like, are you on the internet or not? Yes? Then you are on the internet.
Re:Search all Craigslist cities for a remote job by biztos on Tuesday April 09, 2019 @05:38AM (#19613047)
Maybe timeliness is the important thing to Craigslist.

If you scrape all the jobs data as soon as it shows up, and repost it to your site, then maybe employers think you're the one they should be paying, based on prospects coming in your site and not CL.

I would assume that matters more than if you scraped older data or got older data by scraping it more slowly.