News for hackers. Stuff that matters.
Re:Ask HN: Does Google Index “Secret” URLs Only Shared Throu... by josephcole on Sunday July 02, 2017 @05:32PM (#14684466)
Do you mind if I quote a couple of your articles as long as I provide credit and sources back to your website? http://www.juegosfriv2019.org/ My blog is in the very same area of interest as yours and my visitors would certainly benefit from a lot of the information you present here. http://www.juegosfriv2017.link/ Please let me know if this okay with you. Thank you!
Re:Ask HN: Does Google Index “Secret” URLs Only Shared Throu... by mattbgates on Wednesday June 28, 2017 @04:28PM (#14658022)
Go into Incognito and see if they are showing up there. Google might show you files from Google Drive and other places because you are logged into your Google Account, but it may not show up for anyone else.
Re:Ask HN: Does Google Index “Secret” URLs Only Shared Throu... by macinjosh on Thursday June 29, 2017 @12:15PM (#14664440)
They do show up in incognito.
Re:Ask HN: Does Google Index “Secret” URLs Only Shared Throu... by mattbgates on Thursday June 29, 2017 @10:33PM (#14668300)
Well then, Google is just being Google and indexing everything. You might have to delete it or check your account settings to see if you can make it private.
Re:Ask HN: Does Google Index “Secret” URLs Only Shared Throu... by ParameterOne on Wednesday June 28, 2017 @04:38PM (#14658132)
Google definitely reads your email (gmail). As an example, if I have the word attachment written in my email and then attempt to send the email without any attachments, google will tell me that I used the word attachment in my email but didn't attach anything.
Re:Ask HN: Does Google Index “Secret” URLs Only Shared Throu... by MichaelBurge on Thursday June 29, 2017 @12:28AM (#14660770)
"Reads your email" is ambiguous. All unencrypted email must be read just to transmit it over the network, or to store it on disk. Sounds silly, but the example you gave is actually even more benign: It could be done with Javascript that never sends anything across the network.
Re:Ask HN: Does Google Index “Secret” URLs Only Shared Throu... by claudiulodro on Wednesday June 28, 2017 @12:57PM (#14655837)
You should put a robots.txt file in the S3 bucket if you don't want things in it indexed.

I (kind-of) doubt that they found the files through your e-mail, but the files in your S3 bucket are technically available for indexing since you don't have a robots.txt.

Re:Ask HN: Does Google Index “Secret” URLs Only Shared Throu... by macinjosh on Wednesday June 28, 2017 @01:03PM (#14655884)
I do have a robots.txt, but for whatever reason its not found by Google
Re:Ask HN: Does Google Index “Secret” URLs Only Shared Throu... by iurisilvio on Thursday June 29, 2017 @04:20AM (#14661612)
Are you using a custom domain? Robots.txt must be in your root folder, doesn't work with S3 urls.
Re:Ask HN: Does Google Index “Secret” URLs Only Shared Throu... by macinjosh on Thursday June 29, 2017 @12:15PM (#14664435)
yeah its the S3 URLs that are causing the problem