News for hackers. Stuff that matters.
Re:Scroogle down by medecau on Tuesday May 11, 2010 @03:37AM (#1337199)
Re:Scroogle down by PostOnce on Tuesday May 11, 2010 @04:36AM (#1337264)
I misunderstood you for a moment. I thought you meant to use that instead of scroogle.

Now that I know what you mean, yes, that looks like an ideal solution. The Scroogle people are moaning for no reason. It's not Google's job to provide them with the layout they prefer. How hard is it to scrape Google anyway? It's not Flash-based or anything. Jeez.

Re:Scroogle down by jacquesm on Tuesday May 11, 2010 @07:53AM (#1337506)
Scraping google for an extended period is in fact incredibly hard, but not because of the lay out.

I'm fairly sure that someone on googles management has had to give scroogle a free pass on the scraping because at any serious usage level they'd normally have been blocked long ago. I'm guessing they have weighed the advantages of having scroogle out there versus the disadvantages of a bunch of bad press. They might even think it is good to have sites that are openly critical of google out there.

Scroogle should count their blessings that it has lasted as long as it did, now they should get their act together and fix the bugs in their scraper.

Re:Scroogle down by PostOnce on Tuesday May 11, 2010 @12:59PM (#1338496)
Does Scroogle really generate enough traffic for Google to even notice, or bother taking any action? Does anyone use it on a regular basis?
Re:Scroogle down by jacquesm on Tuesday May 11, 2010 @01:49PM (#1338668)
About 6K uniques on a daily basis. If they sent that to google without some trickery they'd be banned within a day.
Re:Scroogle down by fragmede on Tuesday May 11, 2010 @07:55AM (#1337511)
I would think that the ajax API could also be twisted to their needs. It requires an API key that Google puts some limits on, limits that they might want to apply to Scroogle in any case. http://code.google.com/apis/ajaxsearch/
Re:Scroogle down by goodness on Tuesday May 11, 2010 @11:23AM (#1338142)
Actually, their docs claim that the limits aren't really related to the API key. The API key is just so they can contact you if they start blocking you:

  http://code.google.com/apis/ajaxsearch/key.html
That may just be disinformation though. For example, if you can spread your usage over multiple IPs, you might be allowed more searches than if you told them your API key for all your requests on multiple IP addresses.
Re:Scroogle down by drm237 on Tuesday May 11, 2010 @11:19AM (#1338131)
The ajax api returns completely different results than the normal search and in a different order, so it's not worth using if you want to "actual" google search results.
Re:Scroogle down by est on Tuesday May 11, 2010 @06:48AM (#1337428)
any more like this?