Re:American Chemical Society bans university after "spider-t...
by acdha on Friday April 04, 2014 @09:21AM
(#7531158)
That's opt-in using a <meta> tag:
Re:American Chemical Society bans university after "spider-t...
by raverbashing on Friday April 04, 2014 @09:28AM
(#7531204)
Interesting
In Chrome 32 there's a "Predict network actions to improve page load performance" config option, and here's what it does https://support.google.com/chrome/answer/1385029?hl=en
Re:American Chemical Society bans university after "spider-t...
by nraynaud on Friday April 04, 2014 @09:12AM
(#7531112)
no I think this plan was scrapped, too dangerous (too many websites had stateful actions as GET). I think they just stuck to pre-loading DNS.
edit: and i was messing the webstats for advertisement.
Re:American Chemical Society bans university after "spider-t...
by endianswap on Friday April 04, 2014 @11:18AM
(#7531899)
The best example of a stateful GET action is the Logout button on basically every website (including HN).
Re:American Chemical Society bans university after "spider-t...
by aidenn0 on Friday April 04, 2014 @01:23PM
(#7532891)
We had an internal wiki where the "delete article" link was a GET. Then someone wrote a crawler for it and deleted the entire wiki in 15 minutes. It was changed to a POST after that.
Re:American Chemical Society bans university after "spider-t...
by vijayp on Friday April 04, 2014 @11:27PM
(#7535851)
Heh, this reminds of a story many years ago at Google, where we got angry messages from some guy complaining that Google kept deleting all the photos from his online album.
We eventually figured out he his online album had an unprotected "delete this photo" endpoint via a GET, and no robots restriction! We eventually had to fix the crawler to detect things like this...
Re:American Chemical Society bans university after "spider-t...
by userbinator on Saturday April 05, 2014 @12:14AM
(#7535940)
I bet Google gets tons of these:
http://thedailywtf.com/Articles/The_Spider_of_Doom.aspx
Re:American Chemical Society bans university after "spider-t...
by nraynaud on Saturday April 05, 2014 @02:46AM
(#7536209)
I love this idea that you have to be exceptionally smart not to do the best job, but to do a normal job while surrounded by mediocrity.
Not sure it checks for styling before prefetching them.