News for hackers. Stuff that matters.

A comment on Ask HN: What are best tools for web scraping?. Parent comment

Re:Ask HN: What are best tools for web scraping? by gros_roberts on Tuesday November 14, 2017 @09:19AM (#15695156)
lxml.etree.HTMLParser(recover=True) should work for bad HTML. A few times I had to replace characters before giving the page to lxml, but it was more of an encoding issue.
[ Parent | on HN ]

There are no comments on this comment yet.