Re:Crawl a website with scrapy and store extracted results w...
by the_cat_kittles on Monday April 23, 2012 @03:21PM
(#3880492)
thanks, i should have included a code sample too:
import requests
from lxml import etree
jquery_like_page = etree.HTML(requests.get('url').text)
https://github.com/kennethreitz/requests