Python Libraries you should know about

Re:Python Libraries you should know about by Permit on Monday November 12, 2012 @09:51AM (#4773012)

Is PyQuery fast? The whole premise of the first point was that BeautifulSoup was too slow, but then he didn't provide a comparison between them.

[ Parent | on HN ]

Re:Python Libraries you should know about by kami8845 on Monday November 12, 2012 @10:38AM (#4773214)

Hey Permit. This is a really good point. Looking at PyQuery's source code [0], it really does nothing in terms of parsing other than calling lxml's fromstring function and then works with the result of that when evaluating queries. So it would probably be a tad slower than pure lxml since it also does other bits (like checking for URLs and then fetching them for you) but from looking at the source code, I'd think that the overhead is minimal.

[0] https://github.com/dsc/pyquery/blob/master/pyquery/pyquery.p...

[ Parent | on HN ]

Re:Python Libraries you should know about by Jabbles on Monday November 12, 2012 @11:09AM (#4773363)

Do you have any more up-to-date data than a 2008 comparison?

[ Parent | on HN ]

Re:Python Libraries you should know about by kami8845 on Monday November 12, 2012 @01:37PM (#4774066)

Hey, I commented on this a bit further down in the topic: http://www.crummy.com/2012/1/22/0

[ Parent | on HN ]

Re:Python Libraries you should know about by randallma on Monday November 12, 2012 @12:52PM (#4773834)

The comparison should be moot, because Beautiful Soup 4 uses the lxml parser when it's available: http://www.crummy.com/software/BeautifulSoup/bs4/doc/#specif...

[ Parent | on HN ]

Re:Python Libraries you should know about by tiramisou on Monday November 12, 2012 @10:34AM (#4773194)

It uses lxml, so yes it is fast.

[ Parent | on HN ]

Re:Python Libraries you should know about by streblo on Monday November 12, 2012 @06:42PM (#4775405)

So does BeautifulSoup

[ Parent | on HN ]