- ordinary ppl more or less understand the importance of RTS
- a visible and understandable effect (Meissner) can be shown on successful replication
- the materials required are easier to understand, but the synthesis procedure is tricky, and purity is important
- The skills of chemists comes into play, leading to kind of a Breaking Bad feel
By people who don't know what they're talking about.
You're seriously underestimating the level of expertise that it takes to professionally assess most research. It wouldn't be unusual for there to be a small handful of people with that ability in the world.
This works just as well with less exciting tech, because the point is that we collaboratively learned how to build something.
NASA can't take risks and seriously innovate anymore because even intentional explosions will be passed off as failures, we all experienced the sheer madness of the covid years, similarly anything nuclear brings complete randos out of the woodworks claiming absurd things about its dangers.
Not having some amount of gatekeeping just lowers the bar too much and introduces so much more noise.
I can see how this would be a very controversial subject. Discouraging scientific participation? That's a tough pill to swallow without a lot of justification.
That's not really the case though is it? Doubting someone's credibility would simply mean ignoring their results. But withholding information is something else entirely.
When I mentioned gatekeeping I was specifically referring to how there's this formula that was kept secret since 1999. At some point the potential significance surely became apparent, and one of the only speculations I can come up with to justify that would be gatekeeping; keeping the information out of the hands of the filthy commoners for reasons.
Maybe it wasn't gatekeeping. If not I'd sure as heck like to know what it was.
So no withholding information at all. But on a more general level if everyone would be posting out every little bit of information they produce during their research instead of publishing articles it would be a disaster. The reason we do science is because we are trying to understand things just posting your random results would just give everyone information overload, because you would know what to focus on. Lk99 is actually a great example, the material would have completely been ignored by most (maybe even has been, not sure if they published about it previously?) if not for these recent results. Moreover because the results were published before the authors were confident about what they had, they have been subject to lots of ridicule and accusations of fraud. It might turn out alright in this case, but something like this can be career ending if it turns out to just be an experimental error.
I really do hope it's something innocent like this.
> if everyone would be posting out every little bit of information they produce during their research instead of publishing articles it would be a disaster.
I'm not sure it would be any worse than it already is. I don't see how we could achieve any more bombastic headlines than we already get.
However, what I think happened here is that they weren't able to work on it for a while, and if say, they didn't feel confident in their findings back in 1999 and only got around to being able to look at it again in 2017, it would make sense that their intent wasn't to gatekeep, it had just become one of those "we'll get around to testing it one day" type of projects everyone has. In this case it just potentially was a pretty massive thing to put off.
Was it withheld from the public? Eh... yes? Kind of? Because it was only ever published in a journal - probably Materials Letters, but this was a long time ago - that you would only have access to if you were a graduate (or ambitious undergraduate) student with plenty of time to read in a university library, or a specialist in the very narrow field that journal was for, somebody with a membership included subscription...
This isn't gatekeeping, this is, to be blunt, profit motivated hoarding by a handful of publishers in the academic journals business. And this is the thing that arXiv.org and other pre-print venues are actually having an impact on. I, for one, am strongly in favor of academic information being widely available. I'm not as much in favor of people who have not demonstrated their competencies in something that requires a great deal of both knowledge and skill feeling entitled to being given a platform for their (usually laughably clueless) proposals. If you've done enough work to have a tested hypothesis, that's different.
So I don't think asking about credentials or asking about references is gatekeeping. It's putting a statement into context. If I as a random asshole say "this isn't a superconductor" you as a reader should want to know where I'm getting that opinion from rather than just taking my statement at face value.
> By people who don't know what they're talking about.
I'm glad I'm not the only one who finds all these public mass debaters disgusting.
Of course, we’re often working on a tool to help make tools for other scientists, so that sort of thing is hard to explain to the general public, but ultimately it should terminate in some results that actually have obvious value to society in general.
Does it mean that grant money are distributed by people who are unable to "assess most research"?
Peer review was never a substitute for replication in the first place. In this sense we've been "post-peer-review" the entire time.
The peer review system is broken but I think we still need some sort of structured system in addition to this “hey world, check this out!” method.
The reaction I've seen from most of the scientists has been pretty negative on the papers. The originals aren't strong papers. The chemistry has issues: https://nitter.net/Robert_Palgrave/status/168545015680691814... (unbalanced equations, starting materials have pretty different element ratios to final products). As for the main claim, note that LK-99 seems to be a poorer conductor than copper wire at room temperature: https://nitter.net/bedoya_pinto/status/1686848392616423425#m... which is the kind of thing that should really cause a record scratch and make everyone go "um, I think you did something wrong there"--it's something that absolutely would be caught in peer review.
There is no conclusive proof that this is a superconductor on the replications, but the evidence has been on a different level from nearly everything else you'll find on Arxiv since the beginning.
At monopolar magnetic fields weak enough to come from a permanent magnet is a lot rarer.
Almost all superconductor claims come from measuring magnetic resonance or direct resistance measurements. Both are noisy things to measure, and won't get you reliable results.
It also seems like it has at least pretty strong diamagnetism, which while not a demonstration of superconductivity is both somewhat interesting and gives a vivid demonstration that's amenable to social media.
"Top tier science" is already published on arXiv.
The future happened back in 1995 or something like that.
> Quantity, not quality is king.
No, quality is still king. We don't need videos of flakes standing on their end we need someone who has been working with superconductors all their lives who is competent enough to measure zero resistance across the sample. If one of the wild theories is right we need someone who actually knows how to prove it and not just sound like they're intelligent by talking about 1-d superconductors.
Yeah, that's not how it works.
At practice, anomalies are hyped into everybody's attention, and large samples are drowned out by lack of novelty. You don't need questionable methods to get bad results, you just need quantity.
All the things that are happening are great, and this may be an astonishing discovery. But don't put more certainty on it than it's warranted.
Notably, peer reviews typically don't involve reviewers trying to replicate the results. So we've essentially skipped peer review (at least temporarily) and went full speed ahead with the post-peer-review process.
No, this is a new face for peer review. Existing peer review processes have stagnated in the information age, possibly with good reason. There are a lot of advantages to more immediate review of papers and data, and also to bypassing the systems of qualifications presently used to choose who is a valid reviewer.
Instead of a few anonymous peer reviews, you get the entire planet to replicate. Moment you get something meaningful, publish it on arxiv. Quantity, not quality is king. Anomalies are drowned out by large samples. Questionable methods get mass debated in public.
Scientists are dependent on public funding, why squander the biggest moment in pop science for literal decades?
Now this won't work for 99.99% of research. But top tier research will probably get published on youtube and arxiv in the future...