Ask HN: Query on site scrapping/crawling by YC companies
I am curious to know how YC companies, such as Carsabi & Priceonomics, deal with legal issues that might stem from site scrapping/crawling?
Just wondering as to why HN isn't hosted in the cloud? (e.g. on AWS, Rackspace etc.). How do you backup all the data?
I am curious to know how YC companies, such as Carsabi & Priceonomics, deal with legal issues that might stem from site scrapping/crawling?
My email info is in my profile.
Hey folks,It would be great if you could let me know about the utility of a side-project I have just launched. Its called searchyt:http://news.ycombinator.com/item?id=3174607http://searchyt.twittrank.info/searchyt helps you filter out HN search results based on age, #comments & #points. I figured it might be worthwhile to run queries such as:- What were the most commented stories last...
searchyt is a ThriftDB-based filtered search app for HN. This is the first iteration. Its a side-project of mine. It is not yet fully ready for prime-time but I figured it would be great to garner some early feedback.http://searchyt.twittrank.info/There are still a bunch of features I'm working on. Stay tuned ...