News for hackers. Stuff that matters.
Re:Ask HN: Web crawler/data product ideas? by dalek2point3 on Wednesday January 08, 2014 @12:09AM (#7021815)
one big market for you is researchers. if only i had a penny for each time some economist came to me asking for a list of xxx in yyy, where x could be anything from flight prices, to businesses, to startups and yyy could be city / state/ coutnry /world. The internet is really good for current snapshots, but what reserachers most often need is repeated snapshots of the same thing. that helps us analyze how things change over itme. if you're a data company, please, please dont overwrite your tables to "update". save the old data. its really really useful. for research. and more importantly, for you.
Re:Ask HN: Web crawler/data product ideas? by MechanicalTwerk on Wednesday January 08, 2014 @12:15AM (#7021831)
Thanks. Will definitely look deeper into this. Know of any good sites where researchers make such requests?