News for hackers. Stuff that matters.
Re:Academic Torrents – Making 27TB of research data available by ddebernardy on Sunday August 12, 2018 @09:55AM (#17744353)
Are the datasets all legit? For instance, this looks like a quarterly scrape of Reddit in full:

http://academictorrents.com/details/85a5bd50e4c365f8df70240f...

Re:Academic Torrents – Making 27TB of research data available by matt4711 on Sunday August 12, 2018 @07:16PM (#17747008)
I'm pretty sure all the twitter datasets violate the twitter TOCs.
Re:Academic Torrents – Making 27TB of research data available by JamesMcMinn on Monday August 13, 2018 @08:20AM (#17749486)
On a quick pass of the Twitter datasets, they all seem to conform to Twitter's developer Terms.
Re:Academic Torrents – Making 27TB of research data available by matt4711 on Monday August 13, 2018 @07:35PM (#17754421)
Like the requirement that you have to delete tweets in datasets that have been deleted on twitter?
Re:Academic Torrents – Making 27TB of research data available by JamesMcMinn on Tuesday August 14, 2018 @04:57AM (#17756367)
As far as I could tell, none of them actually contain tweets (e.g. any JSON), just IDs, and mostly user IDs at that.
Re:Academic Torrents – Making 27TB of research data available by robertAngst on Sunday August 12, 2018 @05:21PM (#17746475)
>Are the datasets all legit?

I mean Academia has destroyed the scientific method, turning it into:

Who needs a PhD and what does your Professor want to prove true?

Ive started to ONLY trust industry.

Re:Academic Torrents – Making 27TB of research data available by genericid on Sunday August 12, 2018 @07:54PM (#17747145)
Because industry is dedicated to finding truth?
Re:Academic Torrents – Making 27TB of research data available by woodson on Sunday August 12, 2018 @11:32AM (#17744772)
Not all, some are non-free and commercially licensed.
Re:Academic Torrents – Making 27TB of research data available by detaro on Sunday August 12, 2018 @01:02PM (#17745240)
What makes them "non-legit"?
Re:Academic Torrents – Making 27TB of research data available by onyva on Sunday August 12, 2018 @12:13PM (#17744990)
Seems like you can’t upload unless you have an account registered with an academic email address.
Re:Academic Torrents – Making 27TB of research data available by natch on Sunday August 12, 2018 @12:29PM (#17745073)
The form I saw didn't ask for an academic email address. Just an email address.
Re:Academic Torrents – Making 27TB of research data available by unixhero on Sunday August 12, 2018 @10:53AM (#17744594)
Legit how?
Re:Academic Torrents – Making 27TB of research data available by ddebernardy on Sunday August 12, 2018 @01:18PM (#17745319)
Legit as in not subject to firms potentially coming after them because they're distributing their data. (I've no idea what Reddit's terms are but I wouldn't be surprised if they had an issue or two with a dump of their historical data being available for download free of charge on a 3rd party website.)
Re:Academic Torrents – Making 27TB of research data available by unixhero on Sunday August 12, 2018 @01:37PM (#17745403)
Mostly - This repository is for data hoarders and archivists. They don't necessarily care whether it is legit or legal. The goal is to harvest the most quality data.