News for hackers. Stuff that matters.

samch93

Re:Bayesian Statistics: The three cultures on Friday July 26, 2024 @05:00PM (#41082236)
A (deep) NN is just a really complicated data model, the way one treats the estimation of its parameters and prediction of new data determines whether one is a Bayesian or a frequentist. The Bayesian assigns a distribution to the parameters and then conditions on the data to obtain a posterior distribution based on which a posterior predictive distribution is obtained for new data, while the frequentist treats parameters as fixed quantities and estimates them from the likelihood alone, e.g., with maximum likelihood (potentially using some hacks such as regularization, which themselves can be given a Bayesian interpretation).
probably this article: Hoekstra, R., Morey, R.D., Rouder, J.N. et al. Robust misinterpretation of confidence intervals. Psychon Bull Rev 21, 1157–1164 (2014). https://doi.org/10.3758/s13423-013-0572-3

another good article on misinterpretation of p-values and confidence intervals is: Greenland, S., Senn, S.J., Rothman, K.J. et al. Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations. Eur J Epidemiol 31, 337–350 (2016). https://doi.org/10.1007/s10654-016-0149-3

Re:Science and Statistics (1976) [pdf] on Thursday June 22, 2023 @03:57AM (#36429218)
I agree that there are many things Fisher got wrong (eugenics, tobacco lobbying, etc.), but his contributions to statistics (e.g., maximum likelihood or ANOVA) and genetics are among the most fundamental of the 20th century.
Re:Zelda: Link's Awakening Game Engine Documentation on Friday January 06, 2023 @10:29AM (#34275734)
The Gaming Historian has a good video about the development of the game (https://youtu.be/pfvk6CJ3v34)
Re:Zelda: Link's Awakening Game Engine Documentation on Friday January 06, 2023 @01:38AM (#34271700)
Link's Awakening is such a weird but fascinating entry in the Zelda series. I was not surprised to learn that its story was directly influenced by Twin Peaks.
Re:Show HN: Zelda Breath of The Wild Street View on Monday September 05, 2022 @03:48AM (#32721610)
Nintendo ninjas coming in 3, 2, 1,....
try the following R code:

fisher.test(matrix(c(786, 298, 22999, 11156), nrow = 2))

#> Fisher's Exact Test for Count Data

#>

#>data: matrix(c(786, 298, 22999, 11156), nrow = 2)

#>p-value = 0.0003266

#>alternative hypothesis: true odds ratio is not equal to 1

#>95 percent confidence interval:

#> 1.116046 1.469612

#>sample estimates:

#>odds ratio

#> 1.279435

Re:Why I got a PhD at age 61 on Sunday April 03, 2022 @08:07AM (#30896253)
Do you know about Claude Shannon's Master thesis?
Re:Guetzli vs. MozJPEG on Wednesday March 09, 2022 @08:37PM (#30622280)
Guetzli means cookie in Swiss German, I wonder what inspired the devs to choose that name
It‘s such a tragedy that he died so young. Prof Mackay was a role model who impacted our world in many positive ways (e.g. his work in information theory, Bayesian statistics, environmental science). I recommend his lecture on information theory which is available on youtube [1]. He also documented the progress of his cancer very detailed on his blog [2], which is a very interesting (and sad) read.

[1] https://youtu.be/BCiZc0n6COY

[2] http://itila.blogspot.com/?m=1

The ASA recently published a new statement which is more optimistic about the use of p-values [1]. I myself also think that correctly used p-values are in many situations a good tool for making sense out of data. Of course, a decision should never be conducted on a p-value alone, but the same could also be said about confidence/credible intervals, Bayes factors, relative belief ratios, and any other inferential tool available (and I‘m saying this as someone who is doing research in Bayesian hypothesis testing methodology). Data analysts always need to use common sense and put the data at hand into broader context.

[1] https://projecteuclid.org/journals/annals-of-applied-statist...

Re:What Is a Nomogram? on Thursday September 30, 2021 @10:45AM (#28706915)
A cool nomogram from statistics available here https://bmcmedresmethodol.biomedcentral.com/articles/10.1186... people often confuse the p-value as posterior probability of the null hypothesis. With this nomogram it is possible to compute a bound on the actual probability of the null hypothesis based on a specified prior and p-value.
Re:Why do we use R rather than Excel? on Sunday July 11, 2021 @09:47AM (#27800746)
This is the typical „CS-people“ reaction to learning R. R is a language written by statisticians for statisticians which can be a good but also a bad thing. Fact is that R is the lingua franca of statistics, most new methods will be first available in R, rarely in python, almost never in julia. Despite the superior design of julia, there are good reasons to still use R, for example, there are many state of the art libraries such as ggplot2 or data.table which beat any alternative from python or julia.
Re:Croatian Wikipedia Disinformation Assessment on Saturday June 19, 2021 @05:41PM (#27564714)
Native swiss here and would not sign that swiss german can‘t be understood by germans and that it is a separate language. Austrians and germans who live at the border can very well understand us and their dialects share many features with swiss german, more so than with some german dialects from the north. I think that categorizing swiss german as a separate language is very much an act of balkanization. It is part of the german language whichs spans a large geographic area with many different variations.
Re:Bonzi Buddy on Saturday June 05, 2021 @01:10AM (#27402404)
Can recommend this video from the science elf about bonzi buddy (https://youtu.be/gU1hesbmaKM), great youtube channel!
Re:Pesticides are killing the world's soils on Wednesday June 02, 2021 @01:58AM (#27365366)
Both initiatives are indeed quite drastic, but so is the decline in biodiversity. Double yes from my side!
One of my favorite writers. Highly recommend to read also his less famous works like "das Schloss", "Amerika", or "in der Strafkolonie". If you dig such books, give also Robert Walser and Bruno Schulz a try!
Re:Researchhub: GitHub for Science on Tuesday May 25, 2021 @02:04AM (#27273288)
Reminds me of the open science framework (https://osf.io/), which is widely used by researchers from social sciences / psychology.
Undercurrent is my favorite, closely followed by waltz for debby, stellar artist!
Can recommend the paper "A Reproducible Data Analysis Workflow with R Markdown, Git, Make, and Docker" by Peikert and Brandmaier [1], which shows a much more robust approach to reproducibility.

[1] https://psyarxiv.com/8xzqy/

Re:Peer-reviewed papers are getting increasingly boring on Friday January 01, 2021 @05:08PM (#25607719)
Doug Altman actually wrote a paper about this issue already in 1994 [1]. A great quote: „We need less research, better research, and research done for the right reasons“

[1] https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2539276/pdf/bmj...

Re:The Elements of Statistical Learning [pdf] on Thursday December 31, 2020 @12:08PM (#25594512)
Another hidden gem is Webb‘s Statistical Pattern Recognition https://www.wiley.com/en-us/Statistical+Pattern+Recognition%...
Re:Common color mistakes and how to avoid them on Sunday September 06, 2020 @01:37PM (#24393064)
For all things related to color in data visualization, I can fully recommend the R-package colorspace. For example, the package features colorblind friendly palettes and also the possibility to emulate different forms of color vision deficieny. See the paper on https://arxiv.org/pdf/1903.06490.pdf and the webpage of the project https://colorspace.r-forge.r-project.org/index.html

Older »