News for hackers. Stuff that matters.
Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by andrepd on Saturday March 21, 2020 @08:41AM (#22646138)
>I've been graphing the exp curve

As you can imagine, there's more to epidemiology than this. I'm a big fan of letting the qualified people do their work, while we do ours: shut up and do not spread misinformation.

In fact, at the risk of being rude ill even go so far and say that it's quite arrogant to pretend to pontificate about this when your knowledge about this issue is 0, and also when one major problem in combating this pandemic is the "epidemic of misinformation".

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by throwaway_pdp09 on Saturday March 21, 2020 @09:17AM (#22646292)
And I am having serious misgivings about posting it, nonetheless, many people have expressed deep concerned, and I'm doing the same, only with actual data.

I made it clear the limits of my knowledge - which may still not excuse me, however I have to ask if you are an epidemiologist and if so, please tell me how to model the data better. And I don't mean randomly google up some papers to dump here and pretend you are an expert (unless you are).

How far can I extrapolate e^x before it becomes useless? What are the confidence limits I can use in the extrapolation? How much can I approximate the logistic function with an exponential, when as now, the cases are currently a small fraction of the population? Why is this site http://nrg.cs.ucl.ac.uk/mjh/covid19/ done by experts using log axis any different from mine using curve fitting with exponentials? Why does http://nrg.cs.ucl.ac.uk/mjh/covid19/#w say the USA is 11.5 days behind Italy whereas my amateur attemp suggest ~9 days? (and yes, I wish I'd seen these graphs before I posted) What else have I missed? Criticise freely, with reason, don't just accuse me of misinformation because I posted my fears, which others have done too, only I did the maths.

Now please excuse me while I look at the logistics curve and compare its early stages with exponentiation.

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by YeGoblynQueenne on Saturday March 21, 2020 @09:59AM (#22646498)
>> And I am having serious misgivings about posting it, nonetheless, many people have expressed deep concerned, and I'm doing the same, only with actual data.

There is no "actual data" in your comment above. There is a claim that you make that you have graphed some data, but no graphs and no data.

Also, it doesn't take an epidemiologist to know that a non-epidemiologist should not play at epidemiology. The other poster doesn't have any responsibility to tell you "how to model the data better".

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by throwaway_pdp09 on Saturday March 21, 2020 @10:35AM (#22646735)
> There is no "actual data" in your comment above

There is in http://nrg.cs.ucl.ac.uk/mjh/covid19/#w which I said matches what I've found rather well.

> The other poster doesn't have any responsibility to tell you "how to model the data better".

Yes he does,

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by leereeves on Saturday March 21, 2020 @02:36PM (#22648730)
People spend years studying epidemiology. No one can write a comment here that will teach you how to do it properly.

But I'll try to help. You're looking at a graph of confirmed cases, in other words, positive test results.

That may be due to an increase in the number of infected people; or because the number of tests being performed is increasing, and therefore the percentage of infected people reported as confirmed cases is increasing; or because some positive test results (even with confirmation) are false positives. And there may be other causes that I don't know, because I'm not an epidemiologist either, just a statistics grad student.

Figuring out the the contribution of each cause is a job for the professionals.

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by andrepd on Saturday March 21, 2020 @12:01PM (#22647426)
I don't need to be an aeronautic engineer to know that a person with no such background should not throw hunches about designing planes.
Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by NateEag on Saturday March 21, 2020 @12:00PM (#22647419)
> There is in http://nrg.cs.ucl.ac.uk/mjh/covid19/#w which I said matches what I've found rather well

There may be data there, but if I understand you correctly you did not have it when you made your first post.

It is therefore inadmissible evidence as to whether your first post was a reasonable thing to write.

> Yes he does,

If you have decided you want to be an epidemiologist, or at least to learn their skillset, whose responsibility is it to fulfill that desire?

I don't think there is a reasonable answer to that other than "mine."

[dead]
Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by alien_ on Saturday March 21, 2020 @04:12PM (#22649609)
There's a quote that states that all models are wrong, some happen to be useful.

With this in mind I think we should stop nitpicking on non-specialists who try to raise awareness of this pandemic.

Yes there might be some differences from what a specialist would have done.

Due to the speed at which the situation evolves and the inability to test everyone daily there are lots of unknowns so even a specialist may not be able to give a more much precise figure, everything is going to be a rough estimate.

This is a very serious situation and it's better to err on the caution side, people's lives depend on everyone doing their part.

Non-constructive criticism of people who raise awareness will erode people's buy-in and people will die because of this.

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by andrepd on Saturday March 21, 2020 @03:12PM (#22649074)
Mate I can start to pontificate randomly about aeronautics design, and you can very well tell me to shut up with no requirement that you are an expert yourself.
Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by hanche on Saturday March 21, 2020 @01:07PM (#22647953)
You are absolutely right that the early phase of logistic growth is practically indistinguishable from exponential growth. As to what extent this observation is useful when applied to the current situation, I don't know – I am a mathematician, not an epidemiologist. But as a rough guide to aid understanding, I think it probably has some merit.
Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by throwaway_pdp09 on Saturday March 21, 2020 @04:54PM (#22649991)
Thanks, it's nice to have an expert around! I was going to plot the divergence between the two but got seriously despondent and hit the bottle. Trying to sober up now.

May I ask, what area do you work in, numerical, discrete, logic, other?

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by marvin on Saturday March 21, 2020 @10:15AM (#22646620)
The "behind Italy" number must refer to the number of days after Italy the area reached 100 confirmed cases. Because those numbers obviously don't reflect an extrapolation of the exponential function even 10 days into the future, even corrected for a reduction in the coefficient when numbers grow above 10.000.
Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by gdubs on Saturday March 21, 2020 @10:57AM (#22646908)
I get that your comment is coming from a good place, because the threat of misinformation is real. But this is an “Appeal to Authority” argument. I’d rather have an informed discussion among smart people, even if they’re not experts in the specific field. I’d rather be able to weigh the input of many people. Especially in a case where the experts haven’t done a great job at communicating or understanding the severity of this.

Rather than admonish people to shut up, it would be more constructive to point out the flaws in their methods, so we could all learn and make better judgements.

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by throwaway_pdp09 on Saturday March 21, 2020 @11:16AM (#22647058)
Thank you. To me, that's what it's about. I'd rather try and fail and learn from that, but people just telling me to put a sock in it isn't something I can learn from.
Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by andrepd on Saturday March 21, 2020 @12:27PM (#22647644)
>I’d rather have an informed discussion among smart people

Yes, but that's the thing isn't it? We're not informed, and fitting ke^x to data doesn't make us informed.

This reeks of Dunning-Kruger. I get that the intention is good, but we have to have some humility and not go all "hold on! I'll save the day!"

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by throwaway_pdp09 on Saturday March 21, 2020 @04:30PM (#22649779)
Original poster here.

> and fitting ke^x to data doesn't make us informed

Well, yours is an interesting post but let me ask if curve fitting doesn't make us more informed then what does? There's an update to the data for the US in the past few hours and it doesn't improve things.

I very carefully stated out my limitations, and then pointed them out again when someone critiqued my approach (see edit on https://news.ycombinator.com/item?id=22645793). I have done my best to accept my limitations, but still I get people like you hammering me.

So the question is why are we even posting anything on HN? Bottom line is what is HN for - non-factual debate, or factual debate?

I strongly get the impression that much criticism isn't based on my admittedly trite analysis but because a lot of people just don't know how to handle really bad news and are trying to blank a nasty reality. Doubly so when I'm accused of of "hold on! I'll save the day!" which is purely your invention.

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by ethbro on Saturday March 21, 2020 @10:50PM (#22652289)
> I strongly get the impression that much criticism isn't based on my admittedly trite analysis but because a lot of people just don't know how to handle really bad news and are trying to blank a nasty reality.

No, you just made a large number of flaws in your initial analysis, and it made people despair of going to the effort to point out where you went wrong.

E.g. https://news.ycombinator.com/item?id=22648730

You're producing a future estimate, assuming that all properties of your dataset are consistent (they aren't) and will continue to hold (they won't).

As a few examples: (1) varying ratio of confirmed cases to actual total, (2) % increase in testing per day, day-over-day, (3) varying time offset according to disease progression and symptoms presentation (aka testing).

You seem to be of the opinion that any information is better than no information. In scenarios like this, I'm of the counter opinion that bad information is actively harmful and inferior to no information.

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by throwaway_pdp09 on Sunday March 22, 2020 @07:15AM (#22654150)
> No, you just made a large number of flaws in your initial analysis

Seeing as you don't have access to my analysis, you can't say that.

> You're producing a future estimate, assuming that all properties of your dataset are consistent (they aren't) and will continue to hold (they won't).

This is just vague stuff to put me down. I worked by confirmed cases in publicly available data.

> varying ratio of confirmed cases to actual total

I'm not sure what this mean but I went by the total confirmed cases, day by day. As for your 'increased testing', I'm fully aware the US is finally getting going.

> varying time offset according to disease progression and symptoms presentation (aka testing).

Why would the progress at different rates at different times in different individuals make any difference? I'm going by confirmed cases anyways so unless you know of a new strain with different characteristics that's starting to distort the figures (and there are possibly 2) then it makes no difference.

No, save your slapdowns for the people who push garlic as treatment. You are objecting to me for psychological reasons, not logical ones. You can go to the wiki page and see the growth day by day but you don't want to because it's bad news and you don't like that. Well, get used to it. Your life is going to change, nothing will stop that and the sooner you face it the safer you and your country will be. Hard times ahead. Good luck.

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by andrepd on Sunday March 22, 2020 @08:06AM (#22654368)
This conversation can serve no useful purpose anymore. It's clear that you will never admit that there's anything wrong with your "analysis" (too big a word for pasting data in a spreadsheet), as far as you are concerned, you are a bloody genius (and helping people!) by plotting a bunch of points in a log scale. And of course any criticism of your methods can only be persecution and for "psychological reasons"... I wonder why anybody would post in a discussion forum if they are going to completely ignore any feedback or criticism (and in a very Trump manner say they're victims of personal persecution). Maybe just validation? I don't know, I'm not a psychologist.

Like other people have said through this thread, it's rather simple: you don't know what you are doing, and at this time bad information is worse than no information, and it will hurt people. And reiterating my remarks on my first post: stop being so arrogant, this is really the only word to describe your attitude as far as I'm concerned.

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by throwaway_pdp09 on Sunday March 22, 2020 @09:26AM (#22654792)
It does seem to serve no good purpose when we are talking across each other. For example I clearly and immediately modified my original post to state there was a risk of error because I was using the wrong curve (https://news.ycombinator.com/item?id=22645793).

And "I am a bloody genius [...] by plotting a bunch of points in a log scale" - I actually used the words 'admittedly trite' about what I did.

Whatever. This gets us nowhere. Your profile says you have a background in physics and logic/automated reasoning. I'm just a general purpose back-end dev. We're facing something that may kill more people than WW2, let's concentrate on that. Can we work together to do something useful? Thoughts?

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by throwaway_pdp09 on Sunday March 22, 2020 @02:48PM (#22657453)
aaaand silence. I should have known better than to ask.
Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by DyslexicAtheist on Saturday March 21, 2020 @09:05AM (#22646233)
counter points:

Many doctors lack training in epidemiology. Many epidemiologists aren't actual doctors.

Healthcare in general is horrible with generating accurate raw data (JHU data comes often from scraping websites and the CDC itself has stopped publishing number of daily tests weeks ago). <-- this in fact is a technical problem not a medical one!

You don't have to be a Dr. med in order to see gaps and problems with statistics and a large part of the conjecturing actually comes from gaps and flaws in the sources and the way data is presented. A background in an isolated discipline (only med, only statistics, only Math, etc) is not enough to harness and make sense of complexity.

Finally research papers themselves are all pre-print and not peer-reviewed which is a trade-off in accuracy for speed.

We're all finding solutions as we go and the more eye-balls from different discipline this gets, the better the outcome!

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by YeGoblynQueenne on Saturday March 21, 2020 @09:53AM (#22646461)
>> Many doctors lack training in epidemiology. Many epidemiologists aren't actual doctors.

Yes, and this is why doctors aren't being asked to do epidemiology and epidemiologists aren't being asked to care for patients.

And (likely) sofware engineers are not asked to do either.

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by kazagistar on Saturday March 21, 2020 @10:51AM (#22646857)
I would suggest epidemiologists provide some set of problems all this useless but willing pile of software engineers could apply themselves to. For example, scraping data from mismatched data sources or implementing specific hypothetical models. Even if it's only marginally useful, it would give them something to do other then misinformation.
Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by watwut on Saturday March 21, 2020 @11:01AM (#22646939)
That is what epidemiologists do nowdays and did from the beginning. They don't calculate models on paper anymore.
Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by andrepd on Sunday March 22, 2020 @08:14AM (#22654409)
It's likely that epidemiologists already use those tools. They are, after all, a sort of applied statisticians.
Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by dhimes on Saturday March 21, 2020 @09:58AM (#22646495)
Indeed, you have a point. But in the US at least we have a serious trust issue with what we hear. I believe Fauci, but he still has to play by somebody else's rules.

I too am tracking the numbers. I seriously and honestly expect them to become unavailable- or at least very hard to get to, if things go very very bad.

I expect to see a bump in the "infection rate" in the next few days as testing becomes more widespread. In fact, I expected to see the start of that already, but if it's happened it's not obvious. The number of cases continues to double every two days and change.

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by fragmede on Saturday March 21, 2020 @11:52AM (#22647359)
Epidemiologist are working, and they are saying the same as throwaway_pdp09 - that this is bad. If throwaway_pdp09 were claiming otherwise then it would be a different story. No country is going to change their country's healthcare response plan based on some random conjecturing on HN, and regardless of any numbers that pop out here, the instructions are the same - self-isolate until mid-April, at the soonest.

throwaway_pdp09 isn't spreading unnecessary panic and their attitude has been anything but arrogant, pompous, or dogmatic. They are very open in admitting that they are not an epidemiologist. Saying f(x) = 9 and asking why their 'f' is wrong, and wanting to understanding its shortcomings and how to improve it, seems entirely fine to me. You are going to have to be far more specific on the harm caused by a lay-person projecting that we are fucked in 9 days, vs an expert's opinion that we are going to be fucked in 11.

If it helps, pretend this question is being presented and asked at TA office hours during Epidemiology 101 at university by someone who is considering going into epidemiology.

We are all here to learn.

Meanwhile, there's actual, harmful nonsense out there to rail against. Half-remembered gossip misinformation that spreads like an infectious disease with an R0 of 5. Complete crap, like holding your breath for 10 seconds will test for Covid-19, or that essential oils cure Covid-19 or that its eventual vaccine will cause autism. Fight that misinformation, not people who's latent interest in epidemiology has been awakened. Who knows, a reader here could be deciding to get a degree in epidemiology because of an interest sparked because an exp curve is too simple.

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by throwaway_pdp09 on Saturday March 21, 2020 @12:50PM (#22647823)
Thank you, I appreciate this a a lot.

I'm just trying to make sense of things, same as anybody else. I don't think anybody's fucked either in 9 or 11 days, I actually have a great deal of faith in the United States and yes, I mean it, but bad decisions from high will cause a terrible amount of pain too soon. I just want to wish the US the best because they'll need it now more than any other time, probably in all it's history. I don't think WW2 stressed you as much as you are about to be now. Buckle up yanks and pull together, I believe in you! You will get through this.

Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by jordinl on Saturday March 21, 2020 @08:59AM (#22646202)
Who are these experts you speak of? Are they in US? UK? Italy? Spain?
Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by leetrout on Saturday March 21, 2020 @09:09AM (#22646255)
Some US specific data is at https://covidactnow.org/
Re:The Doctor Who Helped Defeat Smallpox Explains What's Coming by pinkfoot on Saturday March 21, 2020 @09:14AM (#22646274)
China