That's true, but one upside here is that this is not from the guy at Rochester who already got burned twice for publishing false superconductor discoveries. This is at least a report that can't be dismissed immediately.
To be clear, I don't mean to cast unnecessary shade on these current results, I'm just saying the sane and prudent thing to do, especially given LK-99's recent history, is to hold off on any champagne popping, and that appropriate restraint shouldn't be characterized as "false modesty".
Which we should be critical of, but understandable, since that's one of the main reasons to publish (and why I think it is weird we say arxiv papers aren't peer reviewed. That was probably one of the most peer reviewed works in the last decade) and since we're all human. Science is full of mistakes, and is unsurprising when a lot of it is literally trying to do things that humans have never done before (much more to science than this too).
What I thought was really cool about LK-99 is that it isn't too often that people get a first hand look at what goes on inside the science communities. An abnormal amount of attention and openness, but illustrative. Just not sure this is the takeaway people got. But I saw science working in action, and it was really cool.
There are very good reasons to publish before one is "100% certain". It can get lots of other scientists to evaluate your information where they can try to reproduce it or poke holes in your theories. It just makes sense to do that with a tone of "We got some interesting results..." as opposed to what happened in the summer which was more like "We've made one of the biggest discoveries of mankind!!!"
So, the incentives for misuse are really high and the net result is that shortcutting the process is a net drag on progress. People remember the bigs stuff like FTL neutrinos, cold fusion, NK-99, etc but arguably this also shows up as part of the ‘reproducibility crisis’ in many fields.
That’s one of the purposes of arxiv is to allow others to review or comment on the work.
(in the old days, after your article was accepted, but before it was published, they'd send you a few copies labelled "preprint" that you could distribute informally)
https://www.scientificamerican.com/article/controversial-phy...
https://www.nytimes.com/2023/09/29/science/superconductor-re...
There are, but I'd agree that there aren't downsides we should be concerned with. The downside is that if you're trying to publish the work that it can make it easier for the work to be rejected. I'd agree this is dumb, but it is a thing I've seen happen, and be not too uncommon. Just comes down to metrics: academics are judged by citations and number of papers published, thus papers are written to reviewers as opposed to peers (not necessarily the same thing, but assumed they are), also incentivizes flashy results to generate more publicity, or overselling the novelty of work (sometimes even by mistake). But otherwise I agree, and I think it should be encouraged to take a more tempered approach (I think it'll also really help build back social trust in sciences (again, small part of a larger pie)).
I think that given the subject, if this pans out there is no chance they'll get rejected.
Given that the LK-99 theoretical underpinnings were pretty solid (if not the implementation) I've been watching papers in this space. (on google scholar you can just track papers that cite the LK-99 paper as new follow-ups)
It's not false modesty to withhold a conclusion that is unwarranted without more evidence. The last time this happened there was also "possible Meissner effect" that turned out to be diamagnetism.
There are no downsides to being conservative until more evidence is acquired.