News for hackers. Stuff that matters.
Re:Mt. Gox Receives Subpoena From Federal Prosecutor: Source by fabulist on Tuesday February 25, 2014 @09:36PM (#7302451)
I was wondering if they were deliberately allowing archive sites past the paywall.
Re:Mt. Gox Receives Subpoena From Federal Prosecutor: Source by nwh on Tuesday February 25, 2014 @10:14PM (#7302632)
More likely archive.is is pretending to be Googlebot. The author has a lot of server side tricks, like fake Facebook accounts so that it can archive Facebook pages properly.
Re:Mt. Gox Receives Subpoena From Federal Prosecutor: Source by fabulist on Tuesday February 25, 2014 @11:11PM (#7302834)
I'm attempting to replicate this. Searching the last sentence (which is behind the paywall) brings it up in google right away, so I think you're right. However, using Googlebot's user agent doesn't work, so it must be slightly more sophisticated. The result in Google is also not-paywalled, though going directly to the link is. So maybe they use a simpler strategy, and just mess with the parameters. This is the result from google: http://online.wsj.com/news/articles/SB1000142405270230388060...
Re:Mt. Gox Receives Subpoena From Federal Prosecutor: Source by nwh on Tuesday February 25, 2014 @11:20PM (#7302865)
Searching at Google for

    "cache:http://online.wsj.com/news/articles/SB10001424052702303880604579405852448992982?"
gets me the full text article, they could just be stripping the header from the page and displaying that? I know it does detection of cached Google pages in some circumstances.