To be clear, I don't mean to cast unnecessary shade on these current results, I'm just saying the sane and prudent thing to do, especially given LK-99's recent history, is to hold off on any champagne popping, and that appropriate restraint shouldn't be characterized as "false modesty".
Which we should be critical of, but understandable, since that's one of the main reasons to publish (and why I think it is weird we say arxiv papers aren't peer reviewed. That was probably one of the most peer reviewed works in the last decade) and since we're all human. Science is full of mistakes, and is unsurprising when a lot of it is literally trying to do things that humans have never done before (much more to science than this too).
What I thought was really cool about LK-99 is that it isn't too often that people get a first hand look at what goes on inside the science communities. An abnormal amount of attention and openness, but illustrative. Just not sure this is the takeaway people got. But I saw science working in action, and it was really cool.
There are very good reasons to publish before one is "100% certain". It can get lots of other scientists to evaluate your information where they can try to reproduce it or poke holes in your theories. It just makes sense to do that with a tone of "We got some interesting results..." as opposed to what happened in the summer which was more like "We've made one of the biggest discoveries of mankind!!!"
So, the incentives for misuse are really high and the net result is that shortcutting the process is a net drag on progress. People remember the bigs stuff like FTL neutrinos, cold fusion, NK-99, etc but arguably this also shows up as part of the ‘reproducibility crisis’ in many fields.
That’s one of the purposes of arxiv is to allow others to review or comment on the work.
(in the old days, after your article was accepted, but before it was published, they'd send you a few copies labelled "preprint" that you could distribute informally)
https://www.scientificamerican.com/article/controversial-phy...
https://www.nytimes.com/2023/09/29/science/superconductor-re...
That's true, but one upside here is that this is not from the guy at Rochester who already got burned twice for publishing false superconductor discoveries. This is at least a report that can't be dismissed immediately.