News for hackers. Stuff that matters.
Re:Show HN: Scrape the web by injecting JavaScript into web ... by Axsuul on Tuesday December 23, 2014 @12:47PM (#8789147)
What's the benefit of injecting JavaScript into the page when it comes to scraping?
Re:Show HN: Scrape the web by injecting JavaScript into web ... by TheEspion on Tuesday December 23, 2014 @12:56PM (#8789196)
You gain access to the page's own DOM and JavaScript, which lets you call the site's functions to fetch data if it helps you. You can also code your scraper with the same techniques you use when building a page: jQuery, CSS selectors, etc - basically all the good interfaces that have been developed over the past 20 years are available to your scraping code.