Re:Ask YC: Where to start with creating a distributed crawler
by bdr on Sunday March 30, 2008 @12:47PM
(#150209)
BeautifulSoup is not foolproof, meaning it does not always even approximate the way a browser would parse the HTML. One important failure is that it fails to recognize when HTML tags are inside of JavaScript strings (and so should not be considered). Whether this is important or not depends on your application.
[ Parent
| on HN ]
There are no comments on this comment yet.