Re:Meet PastPages.org, the news homepage archive. (And help ...
by atlbeer on Tuesday May 08, 2012 @12:18PM
(#3944372)
What stack are you using for the web page capture?
It's a perfect crisp capture. I've tried before and never got such good programatic results.
Re:Meet PastPages.org, the news homepage archive. (And help ...
by palewire on Tuesday May 08, 2012 @01:09PM
(#3944654)
I'm using Selenium's Firefox driver from inside a Django app. There is Python binding that's slick once you figure out a couple timeout related workarounds that are necessary. Their forums helped me over that hurdle.
Collecting this data cost money. So I've set up a Kickstarter drive to raise funds. If you'd like to help keep PastPages alive, please considering giving.
http://www.kickstarter.com/projects/651552740/keep-pastpages...