News for hackers. Stuff that matters.
Re:Artoo, the client-side scraping companion by nnnnni on Tuesday June 17, 2014 @02:46PM (#7906194)
I would like to see something that helps create useful, specific scrapers for languages like Ruby and Python.

It's annoying to have to run scripts multiple times, tweaking it after each run to get exactly what you need. It's a waste of time...

Re:Artoo, the client-side scraping companion by the_cat_kittles on Wednesday June 18, 2014 @01:20AM (#7908635)

  >> ipython

  [In 1]: from pyquery import PyQuery as pq
  [In 2]: pq("http://www.foo.com")("<some jquery selectors>")
(inspect output, repeat till right)

... or do it with requests + lxml.etree, or whatever you want

when you have what you need, copy and paste into a file

Re:Artoo, the client-side scraping companion by nnnnni on Wednesday June 18, 2014 @06:54AM (#7909375)
PERFECT! Thanks a lot =-)