welcome to the majority of "modeling".
tuning a model to a statistical sample of the past doesn't give as much assurance about it's predictive power as people think.
then, only in the future do we find that the model failed to predict, by which time they tell us, "yeah, but we have a new model", to which the only appropriate answer is "yeah, but you had the same certainty about your old model that did not work"
I'm not saying that there's no point in modelling: you learn a lot about the dynamics of the system when you are working on the model; but that's not what the resultant model conveys.
This is less insightful then you might think, as it's not limited to modeling. We just have a tendency to use previous observations as truth for future endeavors. Mainly because it's usually fine and works fine.
You can see it in every second discussion about any topic that's currently being researched:
I.e. there is nothing guaranteeing we won't have a super viral virus with 90%+ chance of death. It could happen...
There is nothing guaranteeing that LLMs ability to output relevant data will get better, even if it's been tremendously improved within the last year alone.
You can basically see this in action whenever someone is making a prediction. The likelihood of it coming true might be good enough to work with it, but you can always have something go amiss, or a meteor out of currently unknown materials hits the sun causing a chain reaction which causes it to go supernova...
It usually isn't. John Kay and Mervyn King wrote a good book on this issue. They talk about events in three categories. Deterministic predictions, say where is the earth in five years in the solar system, probabilistic predictions based on past data, i.e. how likely is it that the volcano will explode in the next five years, and the most important one which they call 'radically uncertain' events.
Complex human events are almost always in the last category. Using the language from the first or second class of events to make predictions about completely dynamic systems that are entirely dependent on human intervention that have no clear relationship to the past makes no sense. Using quantitative language in that case is actively misleading because it creates the impression you have any notion of the total space of possible events at all. "X has a 80% of going to war in Y years" is an example. What they really mean to say is "I believe it is likely that..", but that 80% number is completely made up.
Or as Frank Knight put it: “A measurable uncertainty, or ‘risk’ proper, as we shall use the term, is so far different from an unmeasurable one that it is not in effect an uncertainty at all.”
What you seems to have an issue with is how it's often reported on or used in politics... But the people actually creating the models are in my experience always aware that the results are never proving anything by themselves... And blaming the act of modeling for the actions of politicians and reporters is misguided, as they're just using whatever is convenient. If it wasn't a specific model, they'd find something else to validate whatever asinine bullshit they're peddling.
They released some model around estimated covid deaths that was just completely wrong around China for the time.
This kind of reminds me of when some journalist on twitter used machine learning to find hate-speech against British politician. Of course the journalist found exactly what they were looking for. There was more hate speech against conservatives... Of course, the journalist was only an amateur in statistics, and used a flawed model, that could have yielded anything they wanted
disclaimer: I didn’t read the article because paywall, and waiting for an archive to be posted.
News source: https://www.bbc.com/news/uk-63330885
Twitter thread: https://twitter.com/petesherlock79/status/159025317484515328...
And a response thread explaining the flaws in the methodology:
As news source: https://novaramedia.com/2022/11/09/the-bbcs-investigation-in...
And on twitter: https://twitter.com/AyoCaesar/status/1590403667974582272
Basically the model was developed at google to find “toxic speech”, but the researchers had a very biased definition on what constituted as “toxic”. Racist speech didn’t count, while angry shouts did.
> I entered a selection of racist tweets I’d received in the past year into Perspective’s API, of varying lengths and sentence complexity. Just to make it easy for the machine, I deliberately chose one which included a common racial slur against South Asians.
> None of these were registered as potentially toxic at all by the AI – but, “You’re a fucking G”, a compliment, popped up with a 90.29% likelihood of being toxic.
Your hypotheses that white MPs experience more racist speech than non-white MPs, is testable. I have a pretty strong feeling that you are wrong, but I haven’t seen any data to support either (only anecdotes; and this deeply flawed analysis). What you can do to test your hypotheses is find all British MPs on twitter, scrape all tweets directed at them, and measure the proportion of racist speech against them. However, I advice you to do a more traditional cluster analysis, rather than a training model, the latter is very likely to yield a flawed model just like the journalist’s “8 month labor of love”.
Russia had not sparked an energy crisis. Russia didn't stop selling energy to EU. It was US that told EU to stop buying energy from Russia and buy from USA instead. It was USA (and Norway) that blew up Nord Stream.
As for who blew up Nord Stream, I don’t think any of us know for sure. Last I heard the US were blaming a pro-Ukrainian group though. I haven’t heard anything about Norway, but haven’t looked into it a lot.
[0] https://www.reuters.com/business/energy/nord-stream-1-gas-pi...
[1] https://amp.cnn.com/cnn/2022/09/02/energy/nord-stream-1-pipe...
[1] https://www.cnbc.com/2021/10/19/energy-crisis-russia-opts-ag...
[2] https://edition.cnn.com/2021/11/05/politics/bill-burns-mosco...
I've checked your account's comments. Frankly, you should be banned from HN:
https://news.ycombinator.com/threads?id=anticodon
You're basically a Russian propaganda bot.
https://news.ycombinator.com/item?id=34643985
> Putin rules the largest country in the world. One of the most rich countries also (in real resources, not just printed money and inflated GDP).
LOL.
EDIT: Another data point would be total solar energy production in winter divided by installed power, per month, in comparison to previous winter.
> We trained our model to predict the daily average gas demand per person for 26 countries (Britain and all EU member states except Malta and Cyprus, which use little or no gas), for each winter month between January 2013 and February 2022. After the model had learned the relationship between temperatures and gas demand, we gave it real temperatures from this winter and asked it to predict how gas usage might have played out had Russia not sparked an energy crisis.