News for hackers. Stuff that matters.

A comment on Better Python Scraping - Installing lxml and Beautiful Soup. Parent comment

Re:Better Python Scraping - Installing lxml and Beautiful Soup by wladimir on Tuesday June 28, 2011 @09:42AM (#2705337)
How is BeautifulSoup "outdated"? It's meant for making it easy to scrape non-properly-formatted sites, and works very well at that, as I've found out in practice.

What's the advantage of Scrapy?

[ Parent | on HN ]
Re:Better Python Scraping - Installing lxml and Beautiful Soup by cdr on Tuesday June 28, 2011 @09:50AM (#2705364)
http://www.crummy.com/software/BeautifulSoup/3.1-problems.ht...

I guess it looks like BeautifulSoup finally got a 4.0 alpha release out which supposedly works, but that took several years. The codebase is aged and releases are incredibly slow.

"I no longer enjoy working on Beautiful Soup..."

"Parsing is longer a competitive advantage for Beautiful Soup, and I'd be happier if I could get out of the parser business altogether."

[ Parent | on HN ]
Re:Better Python Scraping - Installing lxml and Beautiful Soup by wesleyzhao on Tuesday June 28, 2011 @09:58AM (#2705391)
Very interesting... I typically would think you should not use a product that a founder/developer does not believe in
[ Parent | on HN ]