Like, people in this forum assume models are done by data analysts with no special additional knowledge about domain.
Then there were models that specifically searched best case scenario or worst case scenario. The assumptions were clearly stated too, so you was able to determine whether you agree with then or not.
They made predictions about asymptomatic cases before those were actually measured. They made predictions before those hit the news.
They were also pretty open about unknowns and explicitely said what they are not trying to predict.
CT Bergstrom (UW bio prof in communication with IHME team) lays it out in his rapid peer review here: https://twitter.com/CT_Bergstrom/status/1243837050253496320
The uncertainty intervals are pretty confusing even to educated users trying to understand the results in good faith. The entire model used some version of the Wuhan intervention as a prior, and only the uncertainty in fitting curves to that prior is represented in the intervals.
The problem is that the overwhelming majority of the uncertainty in actual outcome doesn't come from the curve-fitting uncertainty, but rather what prior to fit a curve to.
The IHME model seems OK for what it does, but I'm baffled as to how it become the most-cited tool that we have. It's totally inflexible, and pretty confusing in terms of what it actually represents. Its overestimates are now being used as a bludgeon against people that take the virus seriously, which IMO is a major issue and I think wrong, but difficult to refute given how inflexible and confusing the model is.
I don't mean to imply epidemiologists are bad at their jobs! Some areas of science are just like that. It's similarly hard to predict from first principles how effective a new drug will be or what properties a new material will have. But I've seen a lot of people say "we've gotta do suchandsuch because this model I saw projected it as the best option", and that's not a level of confidence these models can actually provide.
"Therefore, characteristics of mixing networks—and how these deviate from the random-mixing norm—have become important applied concerns that may enhance the understanding and prediction of epidemic patterns and intervention measures." [1]
And as a follow-on, that is why there is so much discussion about using mobile apps for contact tracing - it builds the network for you, passively.
1 - https://royalsocietypublishing.org/doi/10.1098/rsif.2005.005...
That isn't my (outsider) understanding, could you provide a reference? By reference I mean a recent survey that demonstrates the specific limitations?
My understanding of the Imperial College model is that it uses a 30m*30m grid of the world and the expected people in the world and various additions to simulate schools and workplaces. Maybe you know better?