News for hackers. Stuff that matters.
Re:Full Reddit Submission Corpus now available for 2006 thru... by lysium on Monday September 28, 2015 @03:36AM (#10289281)
I'm not quite sure how I feel about it. Yes, that data was publicly available, but it 'feels' different that there is now an unalterable snapshot available to the public. No more comment deletion.
Re:Full Reddit Submission Corpus now available for 2006 thru... by Houshalter on Monday September 28, 2015 @03:49AM (#10289313)
That's already true due to a service called: uneddit reddit: http://uneddit.com/ and https://www.unedditreddit.com/

There's also the web archive and search engine indexing.

Re:Full Reddit Submission Corpus now available for 2006 thru... by Implicated on Monday September 28, 2015 @03:43AM (#10289293)
I believe this is just the submissions, not comments (though, it appears that's already been released), based on the post authors comment...

> This dataset will go nicely with the full Reddit Comment Corpus that I released a couple months ago. The link_id from each comment corresponds to the id key in each of the submission objects in this dataset.

Re:Full Reddit Submission Corpus now available for 2006 thru... by Jake232 on Monday September 28, 2015 @03:46AM (#10289303)
A comment dataset was actually already released a while back.
Re:Full Reddit Submission Corpus now available for 2006 thru... by ljk on Monday September 28, 2015 @03:55AM (#10289322)
> No more comment deletion

Isn't that how hackernews is? not being able to delete comments

Re:Full Reddit Submission Corpus now available for 2006 thru... by CardenB on Monday September 28, 2015 @04:28AM (#10289415)
Yeah but I'm sure a lot of people post on here knowing that they won't delete a comment. It's a different story with Reddit, where people have a lot more expectations and it's bigger.
Re:Full Reddit Submission Corpus now available for 2006 thru... by comboy on Monday September 28, 2015 @12:07PM (#10291143)
If somebody believes that he can post something on the internet and then just remove it from existence, then he's probably a politician in EU.
Re:Full Reddit Submission Corpus now available for 2006 thru... by rl3 on Monday September 28, 2015 @06:13AM (#10289662)
Agreed; this feels antithetical to Reddit's principles on some level.

When the next snapshot is released, it will be possible to just perform a diff to discover all deletions and edits since.

Re:Full Reddit Submission Corpus now available for 2006 thru... by grey-area on Monday September 28, 2015 @04:12AM (#10289370)
There's also a backup copy in Utah with all your comments from every site tied to common selectors like your usernames, emails, passwords, ip, credit cards etc. No doubt that'll leak at some point too.

So comment deletion was never going to save you.

Re:Full Reddit Submission Corpus now available for 2006 thru... by tdkl on Monday September 28, 2015 @04:20AM (#10289392)
But we cannot download that one.

This is actually what has been bothering me for a while now. In the past where search engines (well at least the big one) weren't that thorough, you didn't mind if something stayed on the Internet, since it wasn't easily accessible.

But it's a major difference if it's indexed/searchable or downloadable.

Re:Full Reddit Submission Corpus now available for 2006 thru... by hippo8 on Monday September 28, 2015 @04:35AM (#10289430)
This is why, I think we need to make ICT (Information Communication Technology) a mandatory subject in our schools.

Teach kids about the internet. Many people are still under the assumption just deleting something would make it disappear for ever.

Maybe a lot of people from our generation are doomed to sharing too many things online, but we can at least save the next generation from themselves.

You make a mistake 10 years ago, may be a few close friends in your town know about you. Now you make a mistake, the whole world has access to that information.

Government regulations, bans are not going to do anything to stop the spread of information, we need to educate people to protect themselves from their own selves.

Re:Full Reddit Submission Corpus now available for 2006 thru... by eru on Monday September 28, 2015 @07:05AM (#10289786)
Judging by how much of a hash lots of schools are doing with literacy and numeracy (and we've been teaching these things for ages), I don't have high hopes for ICT.
Re:Full Reddit Submission Corpus now available for 2006 thru... by grey-area on Monday September 28, 2015 @04:43AM (#10289447)
But we cannot download that one.

Not yet :)

Given their lax security and general cluelessness of the people in charge, I'm quite sure it will leak at some point, at least partially, perhaps to corporations, perhaps to the public, just as internal NSA docs have leaked. It's very hard to keep things like that airtight forever - all it takes is one slip up and all the info stored could be accessible at some point in the future. It's already indexed and searchable, just not by you.

The important point here is that looking at present day tech (as in your comment on search engine prowess) is not the way to look at it - one day all this information will be accessible to much more intelligent future algorithms, able to link it together in myriad ways and form an almost perfect picture of your life in retrospect. The data is there, and will be stored forever.

Re:Full Reddit Submission Corpus now available for 2006 thru... by r721 on Monday September 28, 2015 @05:26AM (#10289542)
I wonder whether they transformed top secret networks into intentionally slow networks now for large scale leaks to take years or tens of years :)
Re:Full Reddit Submission Corpus now available for 2006 thru... by h37680 on Monday September 28, 2015 @09:04AM (#10290217)
Limiting outgoing traffic would be enough.
Re:Full Reddit Submission Corpus now available for 2006 thru... by r721 on Monday September 28, 2015 @09:46AM (#10290420)
Snowden used "a memory stick and other removable media, including a CD-ROM that he labeled as a Lady Gaga music CD" [1], so this kind of limiting wouldn't work. But he still did loads of internal network data queries, that's what I'm talking about.

[1] http://www.wired.co.uk/news/archive/2013-06/14/snowden-memor...

Re:Full Reddit Submission Corpus now available for 2006 thru... by c4p4c1t0r on Monday September 28, 2015 @11:21AM (#10290891)
You're mixing up Snowden with Manning.
Re:Full Reddit Submission Corpus now available for 2006 thru... by netcraft on Monday September 28, 2015 @09:14AM (#10290256)
What is this referring to?
Re:Full Reddit Submission Corpus now available for 2006 thru... by grey-area on Monday September 28, 2015 @09:28AM (#10290328)
Lots of state agencies collect info like Reddit comments as well as emails, and store it indefinitely. They're already quite good at linking online identities.

https://theintercept.com/2015/09/25/gchq-radio-porn-spies-tr...

https://en.m.wikipedia.org/wiki/Utah_Data_Center

Re:Full Reddit Submission Corpus now available for 2006 thru... by pikzen on Monday September 28, 2015 @09:24AM (#10290305)
NSA's Utah Data Center[0], where they store all the data siphoned off their various programs on the Internet.

[0] https://en.wikipedia.org/wiki/Utah_Data_Center