News for hackers. Stuff that matters.
Re:It’s not just p=0.048 vs. p=0.052 by swsieber on Wednesday September 11, 2019 @09:20AM (#20939809)
For about a year or so now Ive been wanting to make a game about science. It'd basically be a research and discovery simulator, and there would be a free-play mode. Some of the knobs would be # of required replication, required p-value and how good people are at generating hypothesis.

I think it'd be eye opening.

Re:It’s not just p=0.048 vs. p=0.052 by marcosdumay on Wednesday September 11, 2019 @10:01AM (#20940303)
There is a "people will mostly replicate/extend articles about X, and ignore articles about Y" (groupthink) effect that I imagine is also very relevant.
Re:It’s not just p=0.048 vs. p=0.052 by swsieber on Wednesday September 11, 2019 @12:26PM (#20941903)
Oooh, that's a great one to add to the list!
Re:It’s not just p=0.048 vs. p=0.052 by heymijo on Wednesday September 11, 2019 @10:23AM (#20940518)
I hope you do! I think simulations can be a powerful way to teach/learn and I would like to see this one.

I put a reminder to check back with you about this in a few months. Is Keybase your preferred contact method? I know it in name only, but I imagine I can figure it out.

Re:It’s not just p=0.048 vs. p=0.052 by SilasX on Wednesday September 11, 2019 @04:14PM (#20944167)
Yes! Riffing off that, I'd want to do a version where all the data in the game is pure randomness, but where your experimental configurations can influence the outcome. (e.g. you can clean the equipment, which alters the reading, or redo experiments that "went wrong")

You'd be given a prize/goal for publishable findings. Then you'd gradually introduce enough bias into the experiments to get something publishable, and then get hit with the reveal that "oh you were generating effects from random data, jerk".

(Okay, maybe that's overcomplicating it.)

Re:It’s not just p=0.048 vs. p=0.052 by jeffhuys on Wednesday September 11, 2019 @10:18AM (#20940477)
Please do. We're getting closer and closer to the tipping point (although it still might be far away) where people go "Oooohhhh... Well, shit.". Where we all realise. Your game would be one of the many catalysers for this.

This is my opinion of course, it's not like I have any scientific basis for this.