News for hackers. Stuff that matters.
Re:Drinking diet sodas daily during pregnancy linked to auti... by modeless on Saturday September 30, 2023 @12:25PM (#37716988)
> odds were tripled for autism (OR = 3.1; 95% CI: 1.02, 9.7)

This is scientific malpractice! The most ridiculous confidence interval I've ever seen! 1.02 to 9.7, reported as "tripled", seriously? And of course the data is non-blinded survey responses recalling events that occurred many years ago, and the analysis is not preregistered and splits the cohort in an arbitrary way to achieve statistical significance.

How can this drek be published? Everyone involved should be sanctioned. And everyone who took this headline at face value should seriously reconsider their approach to reading science news.

Re:Drinking diet sodas daily during pregnancy linked to auti... by dkasper on Saturday September 30, 2023 @12:34PM (#37717087)
Yeah, I’m gonna need to see some replication with stronger methodology than self reporting and better confidence interval before I put much weight on this study.
Re:Drinking diet sodas daily during pregnancy linked to auti... by xwdv on Saturday September 30, 2023 @12:37PM (#37717115)
Why not put weight on it anyway? As is, the study serves a useful purpose: it discourages people from drinking harmful sodas.
Re:Drinking diet sodas daily during pregnancy linked to auti... by beebmam on Saturday September 30, 2023 @12:40PM (#37717147)
Why discourage people from any behavior without evidence or good reason?
Re:Drinking diet sodas daily during pregnancy linked to auti... by xwdv on Saturday September 30, 2023 @03:08PM (#37718696)
Soda is generally very bad for one’s overall health. Although a person might not care about themselves enough to stop, perhaps they will care if their child is at risk.
Re:Drinking diet sodas daily during pregnancy linked to auti... by jeremyjh on Saturday September 30, 2023 @12:40PM (#37717153)
Yes, misleading people for their own good is such a great strategy, it always works out just fine.
Re:Drinking diet sodas daily during pregnancy linked to auti... by ftxbro on Saturday September 30, 2023 @12:41PM (#37717165)
I'm not sure if this is bait, but it's the kind of thing that makes people not believe scientists and become climate change deniers for example. EDIT: It's bait.
Re:Drinking diet sodas daily during pregnancy linked to auti... by Avshalom on Saturday September 30, 2023 @12:43PM (#37717184)
what is a harmful soda?
Re:Drinking diet sodas daily during pregnancy linked to auti... by achandlerwhite on Saturday September 30, 2023 @12:43PM (#37717188)
"harmful"... citation needed
Re:Drinking diet sodas daily during pregnancy linked to auti... by nikau on Saturday September 30, 2023 @12:46PM (#37717212)
> Why not put weight on

Well they are drinking diet soda...

Re:Drinking diet sodas daily during pregnancy linked to auti... by ToValueFunfetti on Saturday September 30, 2023 @12:46PM (#37717210)
They're at least acknowledging obesity as a confound, but I don't see any reference to sugar sodas or caffeine in a Ctrl-F + skim.
Re:Drinking diet sodas daily during pregnancy linked to auti... by adrr on Saturday September 30, 2023 @01:01PM (#37717388)
I didn’t see any reference to controlling for age which is has been shown to be one the biggest factors in autism.
Re:Drinking diet sodas daily during pregnancy linked to auti... by tpmx on Saturday September 30, 2023 @12:52PM (#37717277)
The r/science discussion of this paper 3 days ago is interesting:

https://old.reddit.com/r/science/comments/16t4eyg/drinking_d...

Re:Drinking diet sodas daily during pregnancy linked to auti... by AdmiralAsshat on Saturday September 30, 2023 @01:02PM (#37717396)
What was it Kurt Vonnegut said? "Pity the reader." The average person has little to no understanding of statistics. The study is coming from a (seemingly) reputable university source. What reason would the uninformed have to be skeptical?
Re:Drinking diet sodas daily during pregnancy linked to auti... by tpmx on Saturday September 30, 2023 @01:21PM (#37717595)
It's published in Nutrients.

https://en.wikipedia.org/wiki/MDPI#Resignations_of_editors

In August 2018, 10 senior editors (including the editor-in-chief) of the journal Nutrients resigned, alleging that MDPI forced the replacement of the editor-in-chief because of his high editorial standards and for resisting pressure to "accept manuscripts of mediocre quality and importance.

Re:Drinking diet sodas daily during pregnancy linked to auti... by dimal on Saturday September 30, 2023 @01:26PM (#37717645)
Yet, on other topics, people have “trust science” drilled into them, and are made to feel like heretics when they’re skeptical. They can’t win.
Re:Drinking diet sodas daily during pregnancy linked to auti... by xtracto on Sunday October 01, 2023 @03:12AM (#37723502)
One should trust science, just dont trust scientists.

I was "around" science for a good chunk of my life (both mom and that used to be academics, and I spent 8 years in academia myself doing a phd and postdoc).

The amount of crap studies, politics and bullshit that happens in those circles will make you realise how sad the state of the "advancement of science" is. And my experience was in 3 very different countries. We desperately need something like AI to be able to synthesize and filter scientific publications

Re:Drinking diet sodas daily during pregnancy linked to auti... by jtaft on Saturday September 30, 2023 @01:09PM (#37717461)
With an 95% confidence interval which doesn’t include zero, doesn’t it mean that it’s statistically significant?

Assuming data is valid and unbiased of course.

Not a statistician, just curious.

Re:Drinking diet sodas daily during pregnancy linked to auti... by wxnx on Saturday September 30, 2023 @01:14PM (#37717513)
Nope, you're thinking of regression coefficients, where you'd be correct that usually the null hypothesis is $\beta = 0$. In this case, what's being reported are odds ratios, so the null hypothesis would be that OR = 1.

The parent comment's point is that although the reported effect is significant at $\alpha = 0.05$ (the usual "95% CI" you mentioned), there are other problems that render their test of this hypothesis less than valid.

Re:Drinking diet sodas daily during pregnancy linked to auti... by jtaft on Saturday September 30, 2023 @01:17PM (#37717546)
Ah thank you, had to read up on odds ratio.

edit for those curious about odds ratio https://www.ncbi.nlm.nih.gov/books/NBK431098/#:~:text=The%20....

Re:Drinking diet sodas daily during pregnancy linked to auti... by jaggederest on Saturday September 30, 2023 @01:14PM (#37717517)
For odds ratio, you're looking for > 1.0, as 1.0 implies "the usual odds" i.e. the null hypothesis.
Re:Drinking diet sodas daily during pregnancy linked to auti... by bogeholm on Saturday September 30, 2023 @01:27PM (#37717655)
> With an 95% confidence interval which doesn’t include zero, doesn’t it mean that it’s statistically significant?

That’s explained here: https://xkcd.com/882/

Re:Drinking diet sodas daily during pregnancy linked to auti... by danShumway on Saturday September 30, 2023 @01:21PM (#37717599)
It's honestly embarrassing to see this article somehow climb to the top of HN. It's a mess of statistical bad practice, self-reported data, and potentially confounded or ignored variables.

Normally when I see a bad study there's like one or two serious problems with methodology, but when I read this through it's almost just every couple of paragraphs that the authors will say something or describe methodology that should be giving the reader pause. From literally the first paragraph in the intro:

> Changes in diagnostic definitions and guidelines and increased testing availability and funding have made major contributions to this increase in diagnosed cases; under the added impacts of changes in dietary, environmental, and other exposures affecting the intrauterine environment, ASD prevalence has reached unprecedented proportions.

Those two sentences contradict each other! You can't just tie them together with a semicolon like one thought implies the other. I'm not even saying that autism cases aren't actually rising at all, but you can't just go "our diagnostic criteria have changed; therefore environmental and dietary exposures are the cause." You have to actually put in the bare-bottom minimal amount of work to describe why you think that diagnostic criteria and social awareness aren't the primary causes, you can't just claim that changing diagnostic criteria itself implies diets are to blame.

It's unsurprising that somebody who would write this way would do bad statistical analysis.

Re:Drinking diet sodas daily during pregnancy linked to auti... by bornfreddy on Saturday September 30, 2023 @01:38PM (#37717803)
> It's honestly embarrassing to see this article somehow climb to the top of HN.

To be fair, upvote doesn't necessarily mean "I agree with this", it often just means "this is the topic I would like to discuss".

I agree that the article is crap though.

Re:Drinking diet sodas daily during pregnancy linked to auti... by bogeholm on Saturday September 30, 2023 @01:32PM (#37717733)
>> Changes in …

> Those two sentences contradict each other!

Id say that it’s a non sequitur; the first part of the sentence before the semicolon states something completely different than what follows, so the ‘impacts’ can’t be ‘added’ - they don’t have the same units.

Re:Drinking diet sodas daily during pregnancy linked to auti... by danShumway on Saturday September 30, 2023 @01:44PM (#37717853)
Fair point; it's not that changing diagnostics mean that there can't be environmental/dietary changes contributing to increased autism cases, it's that the article just entirely skips over that part. It describes an outcome, describes a potential cause that could explain that outcome and then says, "and obviously also diets too."
Re:Drinking diet sodas daily during pregnancy linked to auti... by vegetablepotpie on Saturday September 30, 2023 @02:26PM (#37718305)
I read the article. I fell for it. And I upvoted it.

I understood enough that this study found a correlation and that this was based on surveys. I thought it was an interesting finding, and concluded that this correlation should be examined more closely with more rigorous studies.

I did not go into the details of methodology and statistics and did not conclude, like you did, that this study has dubious value.

This is a trap that the public find themselves in with science reporting. Many people on HN have technical training to grasp these concepts but not understand them. I my self program, and use many of the same intellectual building blocks scientists use in the execution of my job. But I am not a scientist.

I am not a scientist is the key point because it means that I do not understand science. I know the “process” of science. I’ve read scientific papers. I’ve done toy experiments in school and in university. But I don’t understand it. To draw an analogy, Programming is a perception of reality. There are things that I do that I can never explain to management because they do not have direct experience with it. The “identity a bird in the park” XKCD comic is a meme of this concept [1] notwithstanding advances in AI research.

Like programming, science is a perception of reality. Like my management, I may have taken statistics, I know what confidence intervals are. But I have not lived the experience of building an experiment. Getting results, analyzing them, and constructing the distinctions necessary to reach an interesting and valid conclusion. If you’ve gone though that process, you know where to look for problems in a study. I and many people don’t. We will at best say, further study is needed, and at worst say that diet soda causes autism.

The public depends on experts to enter the conversation and share why things are wrong. This of course gets into the problem of “lies will make it half way around the world while the truth is still putting on its shoes”. Retractions may be made, but never perceived. This makes us vulnerable to bad faith actors employing the gish gallop and there’s not a general purpose solution to that.

[1] https://xkcd.com/1425/

Re:Drinking diet sodas daily during pregnancy linked to auti... by smsm42 on Saturday September 30, 2023 @05:30PM (#37720037)
"Vaccines cause autism" is old and tired, but sodas are fashionable bad guys, so "sodas cause autism" is cool.
Re:Drinking diet sodas daily during pregnancy linked to auti... by tomjen3 on Saturday September 30, 2023 @06:01PM (#37720342)
And people wonder why we go to the comments first and the article send, if at all.
Re:Drinking diet sodas daily during pregnancy linked to auti... by lost_tourist on Sunday October 01, 2023 @12:46AM (#37722654)
Yeah I had a nursing friend bring this up to me and I looked up the paper; i don't know jack about the medical industry but these numbers were ridiculous and the methods atrocious lol. I told her that the stats were basically useless which made the paper useless. She didn't like my answer. My two or so diet sodas a day habit will likely continue.