News for hackers. Stuff that matters.
Re:Show HN: I made a tutorial for a basic web scraper with s... by quinnlangille on Monday June 04, 2018 @01:49PM (#17230227)
I was frustrated with the lack of responses from my apartment hunt, so I built a web scraper that deals with finding new posts in certain searches for me

https://medium.freecodecamp.org/how-to-build-a-simple-search...

For those who don't care about the tutorial -> open source repo here -> https://github.com/quinnlangille/pad-patrol

feel free to fork, clone or contribute :~)

Re:Show HN: I made a tutorial for a basic web scraper with s... by rosha on Tuesday June 05, 2018 @12:39PM (#17239412)
Looks good thanks for sharing, you could also use an anonymous scraping API to scale your scraper up if you are crawling on high volumes for instance using this node package. https://www.npmjs.com/package/proxycrawl