Re:Indian Government to develop its own Operating System and...
by rmanocha on Tuesday May 11, 2010 @10:24PM
(#1339950)
Building a new OS can come later (if ever) - they first need to build decent websites for the houses of Parliaments - see http://164.100.47.132/LssNew/members/memberdebate14.aspx?mps... (JS Pagination hurts my sensibilities - as does the more than occasional broken HTML).
I've written scrapers to gather data from these sites for my website, and besides dealing with the above mentioned issues, I have to constantly beware of not overloading their servers - as an example, simply fetching the next page for each MP listed in http://164.100.47.132/LssNew/Members/Alphabaticallist.aspx without a timeout crashes their servers :(.
I've written scrapers to gather data from these sites for my website, and besides dealing with the above mentioned issues, I have to constantly beware of not overloading their servers - as an example, simply fetching the next page for each MP listed in http://164.100.47.132/LssNew/Members/Alphabaticallist.aspx without a timeout crashes their servers :(.