News for hackers. Stuff that matters.
Re:Ask HN: What are best tools for web scraping? by Doctor_Fegg on Tuesday November 14, 2017 @08:05AM (#15694612)
If you speak Ruby, mechanize is good: https://github.com/sparklemotion/mechanize
Re:Ask HN: What are best tools for web scraping? by DrSayre on Tuesday November 14, 2017 @09:39AM (#15695341)
I generally use mechanize when I need to scrape something from the web. I found this awhile back and it's helped me https://www.chrismytton.uk/2015/01/19/web-scraping-with-ruby...
Re:Ask HN: What are best tools for web scraping? by faitswulff on Tuesday November 14, 2017 @08:23AM (#15694733)
I remember trying to use mechanize as a beginning rubyist and I can't recommend it from that experience. Specifically I remember poor documentation and confusing layers of abstraction. It might be better now that I know what the DOM is and how jQuery selectors work, but my first impression was abysmal.