Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Web Scraping with Beautiful Soup (2014).
-Beautiful Soup
-Requests Lib
-JSON Lib
-Selenium
-Urllib2
-Cookielib
Handles 99% of things I encounter. With dynamic sites, you're often better off simulating the request than controlling the browser.
Then you get to parse your way through someone's annoyingly formatted JSON.
There are no comments on this comment yet.
-Beautiful Soup
-Requests Lib
-JSON Lib
-Selenium
-Urllib2
-Cookielib
Handles 99% of things I encounter. With dynamic sites, you're often better off simulating the request than controlling the browser.
Then you get to parse your way through someone's annoyingly formatted JSON.