Re:Better Python Scraping - Installing lxml and Beautiful Soup
by cdr on Tuesday June 28, 2011 @09:33AM
(#2705301)
Offtopic: Inputting text with Swype on Android is a breeze once you get used to it.
Re:Better Python Scraping - Installing lxml and Beautiful Soup
by wesleyzhao on Tuesday June 28, 2011 @09:25AM
(#2705280)
Hm interesting thought. Any good tutorials/sites I can use to get going on this? Or is it so simple I won't even need that. I find myself scraping a lot, so finding the best lib for that is a priority.
Re:Better Python Scraping - Installing lxml and Beautiful Soup
by pxm on Tuesday June 28, 2011 @03:43PM
(#2706961)
Just tried this out last week. The docs are pretty sparse, but it seems to mirror the jQuery interface fairly closely so if you're familiar with one, you'll have a fair idea of the other: http://packages.python.org/pyquery/api.html
That's the key advantage as I see it. If I'm scraping something it's often in a hurry and I just want it done. Not having to internalise a new API is a significant win in that respect.
Re:Better Python Scraping - Installing lxml and Beautiful Soup
by ericmoritz on Tuesday June 28, 2011 @11:36AM
(#2705781)
I second that, PyQuery is excellent. I've even used it for manipulating an RSS feed: http://pastebin.com/QnF0Li3m
Its the same as jquery, but in Python.
Working with beatiful soup quickly becomes.long.and messy and tedious
With pyquery, you get what you want with just a couple of CSS 3 selectors simplw and nice
wow android 2.2 is terrible for inputting text