News for hackers. Stuff that matters.
Re:Principles of good data analysis by westurner on Sunday March 23, 2014 @03:31PM (#7454688)
Helpful; thanks!

"Ten Simple Rules for Reproducible Computational Research" http://www.ploscompbiol.org/article/info%3Adoi%2F10.1371%2Fj...

* Rule 1: For Every Result, Keep Track of How It Was Produced

* Rule 2: Avoid Manual Data Manipulation Steps

* Rule 3: Archive the Exact Versions of All External Programs Used

* Rule 4: Version Control All Custom Scripts

* Rule 5: Record All Intermediate Results, When Possible in Standardized Formats

* Rule 6: For Analyses That Include Randomness, Note Underlying Random Seeds

* Rule 7: Always Store Raw Data behind Plots

* Rule 8: Generate Hierarchical Analysis Output, Allowing Layers of Increasing Detail to Be Inspected

* Rule 9: Connect Textual Statements to Underlying Results

* Rule 10: Provide Public Access to Scripts, Runs, and Results

Sandve GK, Nekrutenko A, Taylor J, Hovig E (2013) Ten Simple Rules for Reproducible Computational Research. PLoS Comput Biol 9(10): e1003285. doi:10.1371/journal.pcbi.1003285

Re:Principles of good data analysis by needacig on Sunday March 23, 2014 @04:00PM (#7454845)
This is way more useful than the original post, thanks.
Re:Principles of good data analysis by achompas on Sunday March 23, 2014 @05:17PM (#7455189)
This is great, thank you!
Re:Principles of good data analysis by ethikal on Sunday March 23, 2014 @04:08PM (#7454880)
Great post! You mention that it is important to "be skeptical" - I concur and would add that it's helpful to approach the analysis from a non-biased standpoint. Even if you are going into your analysis with certain goals in mind, it is not only more ethical, but also more persuasive, to indicate any inconsistencies in your findings.
Re:Principles of good data analysis by zengr on Sunday March 23, 2014 @03:38PM (#7454718)
I think for "Profile your data", some tools like OpenRefine really help. http://openrefine.org
Re:Principles of good data analysis by gjreda on Sunday March 23, 2014 @06:54PM (#7455620)
I forgot to mention reproducibility. Show your work (share the code).