News for hackers. Stuff that matters.
Re:Better Python Scraping - Installing lxml and Beautiful Soup by ljlolel on Tuesday June 28, 2011 @09:15AM (#2705240)
Ive scraped dozens of sites beautiful.soup is great, but if you want the job done as quickly and cleanly as possible, PyQuery is thr best.

Its the same as jquery, but in Python.

Working with beatiful soup quickly becomes.long.and messy and tedious

With pyquery, you get what you want with just a couple of CSS 3 selectors simplw and nice

wow android 2.2 is terrible for inputting text

Re:Better Python Scraping - Installing lxml and Beautiful Soup by cdr on Tuesday June 28, 2011 @09:33AM (#2705301)
Offtopic: Inputting text with Swype on Android is a breeze once you get used to it.
Re:Better Python Scraping - Installing lxml and Beautiful Soup by wesleyzhao on Tuesday June 28, 2011 @09:25AM (#2705280)
Hm interesting thought. Any good tutorials/sites I can use to get going on this? Or is it so simple I won't even need that. I find myself scraping a lot, so finding the best lib for that is a priority.
Re:Better Python Scraping - Installing lxml and Beautiful Soup by pxm on Tuesday June 28, 2011 @03:43PM (#2706961)
Just tried this out last week. The docs are pretty sparse, but it seems to mirror the jQuery interface fairly closely so if you're familiar with one, you'll have a fair idea of the other: http://packages.python.org/pyquery/api.html

That's the key advantage as I see it. If I'm scraping something it's often in a hurry and I just want it done. Not having to internalise a new API is a significant win in that respect.

Re:Better Python Scraping - Installing lxml and Beautiful Soup by ericmoritz on Tuesday June 28, 2011 @11:36AM (#2705781)
I second that, PyQuery is excellent. I've even used it for manipulating an RSS feed: http://pastebin.com/QnF0Li3m