Re:Ask HN: What are best tools for web scraping?
by Doctor_Fegg on Tuesday November 14, 2017 @08:05AM
(#15694612)
If you speak Ruby, mechanize is good: https://github.com/sparklemotion/mechanize
[ Parent
| on HN ]
Re:Ask HN: What are best tools for web scraping?
by DrSayre on Tuesday November 14, 2017 @09:39AM
(#15695341)
I generally use mechanize when I need to scrape something from the web. I found this awhile back and it's helped me https://www.chrismytton.uk/2015/01/19/web-scraping-with-ruby...
Re:Ask HN: What are best tools for web scraping?
by faitswulff on Tuesday November 14, 2017 @08:23AM
(#15694733)
I remember trying to use mechanize as a beginning rubyist and I can't recommend it from that experience. Specifically I remember poor documentation and confusing layers of abstraction. It might be better now that I know what the DOM is and how jQuery selectors work, but my first impression was abysmal.