News for hackers. Stuff that matters.
Re:How to Read a Log Scale by NicolasGorden on Sunday August 30, 2020 @04:15PM (#24325574)
I often think that one of the biggest changes that could come would be the mass adoption of through statistical analysis classes as part of graduate programs.

There's far, far too many people I've know who just don't understand it.

I also see many forces working against it. For one, it'd show up the ignorance of a lot of the academic world.

I've known high level people, like a MD, who simply didn't fully grasp some basic concepts of statistical analysis (like P-value hacking, questioning sample size, comparisons between raw numbers, etc)

Re:How to Read a Log Scale by detaro on Sunday August 30, 2020 @05:52PM (#24326231)
Statistics should be part of pretty much every step of education IMHO. Even in elementary school you can teach useful things about reading statistics, high-school math allows more, and universities should cover it too (again with different focus depending on subject and depth of math classes). It's among the most universally useful in life parts of mathematics.
Re:How to Read a Log Scale by hinkley on Monday August 31, 2020 @02:37AM (#24329012)
Even enough statistics to do better in a game that uses dice or card decks would help people a lot in other aspects of life.
Re:How to Read a Log Scale by sukilot on Sunday August 30, 2020 @06:30PM (#24326512)
Everyone in these industries takes statistics in college and maybe grad school tool. The problem is (1) that statistics is hard math and these people aren't math majors (2) if you do statistics correctly you can never say anything bold with confidence, which kills your career in any field except statistics itself
Re:How to Read a Log Scale by mhh__ on Sunday August 30, 2020 @08:18PM (#24327242)
In the sense that there are courses like Physics for future presidents, it must be possible to at least attune peoples bullshit receptors to some degree - even if that is without going into the mathematics.

We now live in a time when media algorithmically shows you what you want to see, and politicians have effectively worked out that truth is almost totally unnecessary. Society will adapt, but it could end in disaster.

Re:How to Read a Log Scale by godelski on Sunday August 30, 2020 @10:40PM (#24328042)
For example, one thing that most people don't get is that every measurement has an assumption. If you don't know the assumption you may make bad conclusions. Few people even ask this question when making measurements.
Re:How to Read a Log Scale by tuatoru on Sunday August 30, 2020 @06:45PM (#24326633)
Stats courses for non-statisticians should focus on teaching people how to tell when they need to call in an expert. (Which is most of the time, of course. And that is not unique to statistics.)

And academic journals in medicine etc. need to require that research involving the use of statistics has been reviewed and okayed by specialist statisticians, and prioritise publishing null results. The last would save future researchers a lot of time.

Re:How to Read a Log Scale by NicolasGorden on Sunday August 30, 2020 @11:54PM (#24328365)
I should have been more careful in wording my original comment.

I know there are statistics classes given in most professions. But those classes generally are graded on a bell curve and many people I've known have passed such classes without really 'getting much'.

Also, my comment should have specified statistics as part of critical thinking and analysis of complex phenomena.

Re:How to Read a Log Scale by analog31 on Monday August 31, 2020 @01:37PM (#24333886)
A problem with training requirements seems analogous to Goodheart's Law. If you make something a requirement for graduating, then you have to make it easy enough for everybody to pass, in which case it turns into fluff.

But this isn't even statistics. We learned to read log plots in high school chemistry class.

Re:How to Read a Log Scale by emmelaich on Sunday August 30, 2020 @10:08PM (#24327865)
> like a MD

A doctor 'invented' calculus in 1994. You don't know whether to admire or regret - the lack of exposure to maths.

https://pubmed.ncbi.nlm.nih.gov/8137688/

Re:How to Read a Log Scale by akovaski on Monday August 31, 2020 @12:25AM (#24328485)
To insert a bit of sanity: from a reply by the author, she indicates that she wasn't trying to introduce a novel concept with estimating an area using right trapezoids. I don't have access to the journal, so I can't read her entire comment.

https://care.diabetesjournals.org/content/17/10/1225.2

Re:How to Read a Log Scale by NicolasGorden on Monday August 31, 2020 @12:00AM (#24328385)
My comment wasn't, 'doctors don't know math and I'm so smart', but rather the oposite. I was surprise was when I found a doctor who didn't have a firm grasp of basic principals of statistical analysis. And how through my life I've encountered a lot of high level professionals who far exceed me in success, confess to not understanding certain concepts I considered are objectively very basic.
Re:How to Read a Log Scale by godelski on Sunday August 30, 2020 @10:39PM (#24328035)
Doesn't he even cite a calculus book?
Re:How to Read a Log Scale by melenaos on Monday August 31, 2020 @05:27AM (#24329734)
I did statistics two semesters for a Software engineering major but i still cannot understand these graphs!

I know maths, theoretical and applied but statistics is such a difficult thing because you dont have to prove anything, you have to communicate a message to a human person. Even worse, to find these hidden messages within the data.

Re:How to Read a Log Scale by CharlesW on Sunday August 30, 2020 @06:02PM (#24326300)
> I often think that one of the biggest changes that could come would be the mass adoption of through statistical analysis classes as part of graduate programs.

Can anyone recommend a good introductory course, ideally with a path to more advanced courses?

Re:How to Read a Log Scale by MaxBarraclough on Sunday August 30, 2020 @05:26PM (#24326066)
> comparisons between raw numbers

What do you mean by this one?

Re:How to Read a Log Scale by selectodude on Sunday August 30, 2020 @05:39PM (#24326140)
A popular one is comparing the violence in cities by their raw numbers instead of per-capita.
Re:How to Read a Log Scale by godelski on Sunday August 30, 2020 @10:45PM (#24328061)
Whenever someone mentions raw numbers alarm bells go off in my head and I immediately assume there's some agenda. This should be normal, especially when people do such atrocious comparisons like x events in America vs y events in Iceland. Yet we see it done all the time.
Re:How to Read a Log Scale by cauliflower2718 on Sunday August 30, 2020 @08:58PM (#24327475)
I remember learning this in both high school physics and high school chemistry for unit conversions.
Re:How to Read a Log Scale by necheffa on Sunday August 30, 2020 @06:38PM (#24326580)
Sometimes you cannot directly compare two numbers because they are on two different scales. It is basically like saying 10cm is bigger than 5in because there are 10, ignoring the fact that if you normalized the values, 5in would be a larger distance.

Of course, it is usually never as obvious to the casual observer as using inconsistent units of linear distance.

Re:How to Read a Log Scale by godelski on Sunday August 30, 2020 @10:50PM (#24328085)
Worse than this, sometimes you can't even compare numbers on the same scale. Inherit assumptions make things difficult to compare. For example: some event may depend highly on the interconnectedness (maximal clique in a graph) than population and this a per capita comparison isn't relevant.

But this is much more than statistics, this is understanding measurements and events. This is really the fundamental problem here, not a lack of understanding statistics (though good statisticians are experts in asking these types of questions).

Re:How to Read a Log Scale by emmelaich on Sunday August 30, 2020 @10:12PM (#24327894)
You might be amused my this -- Limmy on feathers and steel.

https://www.youtube.com/watch?v=-fC2oke5MFg

Not sure why I couldn't find it on his channel. https://www.youtube.com/c/LimmyLimond/