News for hackers. Stuff that matters.
Re:Andrew McCalip demonstrates synthesis of LK99 by DoingIsLearning on Friday August 04, 2023 @07:31AM (#36998478)
The first pre-print came out on 22 July (if I am not mistaken). Not enough time has passed pure and simple.

If I was an academic working on this, I would be following the Sagan Standard and triple checking my results before claiming anything.

I think we are all suffering from 24 hour news cycles. The work in China and now Varda is very exciting but they are warp speed developments.

Re:Andrew McCalip demonstrates synthesis of LK99 by anonylizard on Friday August 04, 2023 @08:06AM (#36998814)
This is simply what post-peer-review looks like.

Instead of a few anonymous peer reviews, you get the entire planet to replicate. Moment you get something meaningful, publish it on arxiv. Quantity, not quality is king. Anomalies are drowned out by large samples. Questionable methods get mass debated in public.

Scientists are dependent on public funding, why squander the biggest moment in pop science for literal decades?

Now this won't work for 99.99% of research. But top tier research will probably get published on youtube and arxiv in the future...

Re:Andrew McCalip demonstrates synthesis of LK99 by ironborn123 on Friday August 04, 2023 @08:35AM (#36999099)
This kind of public interest and demonstrations is unique only to RTS and few other phenomena

- ordinary ppl more or less understand the importance of RTS

- a visible and understandable effect (Meissner) can be shown on successful replication

- the materials required are easier to understand, but the synthesis procedure is tricky, and purity is important

- The skills of chemists comes into play, leading to kind of a Breaking Bad feel

Re:Andrew McCalip demonstrates synthesis of LK99 by CharlieDigital on Friday August 04, 2023 @08:16AM (#36998912)
Not all meaningful science is this level of groundbreaking for this model to work. Formal peer review is still very much necessary.
Re:Andrew McCalip demonstrates synthesis of LK99 by svara on Friday August 04, 2023 @09:27AM (#36999717)
> Questionable methods get mass debated in public.

By people who don't know what they're talking about.

You're seriously underestimating the level of expertise that it takes to professionally assess most research. It wouldn't be unusual for there to be a small handful of people with that ability in the world.

Re:Andrew McCalip demonstrates synthesis of LK99 by generalizations on Friday August 04, 2023 @09:42AM (#36999918)
What matters is the discovery of new things that are true, that we can do engineering with. Publication by youtube & arxiv doesn't have to be oriented at public consumption - it works just as well when it's by-researchers, for-researchers. Except without gatekeeping, people like McCalip can participate too. Who cares who's sitting on the sidelines? In post-peer-review, industry-funded academics rush a paper to a preprint server, a space engineer replicates it, and someone else figures out how to mass-produce it, and we get room-temp ambient-pressure superconductors, and we know we did because the engineering works.

This works just as well with less exciting tech, because the point is that we collaboratively learned how to build something.

Re:Andrew McCalip demonstrates synthesis of LK99 by MetaWhirledPeas on Friday August 04, 2023 @10:29AM (#37000578)
Agreed. What I don't understand is the gatekeeping. Why would the actions of outsiders have any bearing on "real" research? Are they worried that grant money will get redirected toward shallower, more glamorous groups?
Re:Andrew McCalip demonstrates synthesis of LK99 by dotnet00 on Friday August 04, 2023 @11:37AM (#37001482)
I think the gatekeeping is relevant because almost every time in recent years that the general completely unvetted, often actively ignorant public has gotten an in on the scientific/R&D process, it has been a disaster for the field.

NASA can't take risks and seriously innovate anymore because even intentional explosions will be passed off as failures, we all experienced the sheer madness of the covid years, similarly anything nuclear brings complete randos out of the woodworks claiming absurd things about its dangers.

Not having some amount of gatekeeping just lowers the bar too much and introduces so much more noise.

Re:Andrew McCalip demonstrates synthesis of LK99 by MetaWhirledPeas on Friday August 04, 2023 @12:01PM (#37001818)
> Not having some amount of gatekeeping just lowers the bar too much and introduces so much more noise.

I can see how this would be a very controversial subject. Discouraging scientific participation? That's a tough pill to swallow without a lot of justification.

Re:Andrew McCalip demonstrates synthesis of LK99 by dotnet00 on Friday August 04, 2023 @12:15PM (#37002013)
It isn't discouraging participation, it's requiring that you meet some minimum level of proficiency to be considered credible. Kind of like how you need to have some experience in programming to have any credibility when talking about how a programming language should be designed.
Re:Andrew McCalip demonstrates synthesis of LK99 by MetaWhirledPeas on Friday August 04, 2023 @12:18PM (#37002072)
> it's requiring that you meet some minimum level of proficiency to be considered credible

That's not really the case though is it? Doubting someone's credibility would simply mean ignoring their results. But withholding information is something else entirely.

Re:Andrew McCalip demonstrates synthesis of LK99 by dotnet00 on Friday August 04, 2023 @12:21PM (#37002119)
Maybe I'm misunderstanding, where did withholding information come into this?
Re:Andrew McCalip demonstrates synthesis of LK99 by MetaWhirledPeas on Friday August 04, 2023 @12:28PM (#37002228)
> Maybe I'm misunderstanding, where did withholding information come into this?

When I mentioned gatekeeping I was specifically referring to how there's this formula that was kept secret since 1999. At some point the potential significance surely became apparent, and one of the only speculations I can come up with to justify that would be gatekeeping; keeping the information out of the hands of the filthy commoners for reasons.

Maybe it wasn't gatekeeping. If not I'd sure as heck like to know what it was.

Re:Andrew McCalip demonstrates synthesis of LK99 by cycomanic on Friday August 04, 2023 @12:59PM (#37002651)
They didn't keep it, they simply did not work on it and only came back to it 20 years later (somebody posted a bit of history on the other thread currently on the front page, I'm on mobile so it takes to long to find it atm). They didn't know about it's superconducting properties either.

So no withholding information at all. But on a more general level if everyone would be posting out every little bit of information they produce during their research instead of publishing articles it would be a disaster. The reason we do science is because we are trying to understand things just posting your random results would just give everyone information overload, because you would know what to focus on. Lk99 is actually a great example, the material would have completely been ignored by most (maybe even has been, not sure if they published about it previously?) if not for these recent results. Moreover because the results were published before the authors were confident about what they had, they have been subject to lots of ridicule and accusations of fraud. It might turn out alright in this case, but something like this can be career ending if it turns out to just be an experimental error.

Re:Andrew McCalip demonstrates synthesis of LK99 by MetaWhirledPeas on Friday August 04, 2023 @01:23PM (#37003011)
> They didn't keep it, they simply did not work on it and only came back to it 20 years later (somebody posted a bit of history on the other thread currently on the front page, I'm on mobile so it takes to long to find it atm). They didn't know about it's superconducting properties either.

I really do hope it's something innocent like this.

> if everyone would be posting out every little bit of information they produce during their research instead of publishing articles it would be a disaster.

I'm not sure it would be any worse than it already is. I don't see how we could achieve any more bombastic headlines than we already get.

Re:Andrew McCalip demonstrates synthesis of LK99 by dotnet00 on Friday August 04, 2023 @01:01PM (#37002690)
Ah, then I completely misunderstood you. Yeah I'm not in favor of outright withholding information.

However, what I think happened here is that they weren't able to work on it for a while, and if say, they didn't feel confident in their findings back in 1999 and only got around to being able to look at it again in 2017, it would make sense that their intent wasn't to gatekeep, it had just become one of those "we'll get around to testing it one day" type of projects everyone has. In this case it just potentially was a pretty massive thing to put off.

Re:Andrew McCalip demonstrates synthesis of LK99 by nyospe on Friday August 04, 2023 @01:40PM (#37003253)
In 1999, I was still a student in solid state physics, not far past my bachelor's degree, and happened to notice the publication of something that, to this day, I suspect might be (note, load bearing "might") a critical breakthrough for desalination. Nothing came of it. Nobody has published any follow-up for it. Nobody has done any research that would contradict it either. It's just sitting out there, unnoticed, decades later.

Was it withheld from the public? Eh... yes? Kind of? Because it was only ever published in a journal - probably Materials Letters, but this was a long time ago - that you would only have access to if you were a graduate (or ambitious undergraduate) student with plenty of time to read in a university library, or a specialist in the very narrow field that journal was for, somebody with a membership included subscription...

This isn't gatekeeping, this is, to be blunt, profit motivated hoarding by a handful of publishers in the academic journals business. And this is the thing that arXiv.org and other pre-print venues are actually having an impact on. I, for one, am strongly in favor of academic information being widely available. I'm not as much in favor of people who have not demonstrated their competencies in something that requires a great deal of both knowledge and skill feeling entitled to being given a platform for their (usually laughably clueless) proposals. If you've done enough work to have a tested hypothesis, that's different.

Re:Andrew McCalip demonstrates synthesis of LK99 by Vecr on Friday August 04, 2023 @03:50PM (#37004970)
At least post the citation for the desal thing?
Re:Andrew McCalip demonstrates synthesis of LK99 by giantrobot on Friday August 04, 2023 @12:04PM (#37001860)
My personal opinion/reaction likely isn't going to affect anyone's grant status. I'm just a random asshole. But there are less random assholes whose opinion might count. If someone sounding authoritative, but is just a random asshole like me, shits on this work on social media it might affect a group's grant status if it taints the opinion of someone holding the purse strings.

So I don't think asking about credentials or asking about references is gatekeeping. It's putting a statement into context. If I as a random asshole say "this isn't a superconductor" you as a reader should want to know where I'm getting that opinion from rather than just taking my statement at face value.

Re:Andrew McCalip demonstrates synthesis of LK99 by MetaWhirledPeas on Friday August 04, 2023 @12:21PM (#37002127)
I'm not suggesting we give random people credibility: I'm suggesting that when we make potentially-enormous breakthroughs that maybe we shouldn't keep that information to ourselves for decades.
Re:Andrew McCalip demonstrates synthesis of LK99 by okonomiyaki3000 on Friday August 04, 2023 @10:00AM (#37000171)
> > Questionable methods get mass debated in public.

> By people who don't know what they're talking about.

I'm glad I'm not the only one who finds all these public mass debaters disgusting.

Re:Andrew McCalip demonstrates synthesis of LK99 by bee_rider on Friday August 04, 2023 @10:52AM (#37000861)
They say you don’t really understand something until you can teach it. I wonder to what extent “can I teach this to the general public, and do they care?” is an indicator of both understanding new results and also whether or not they really matter.

Of course, we’re often working on a tool to help make tools for other scientists, so that sort of thing is hard to explain to the general public, but ultimately it should terminate in some results that actually have obvious value to society in general.

Re:Andrew McCalip demonstrates synthesis of LK99 by codedokode on Friday August 04, 2023 @11:11AM (#37001107)
> You're seriously underestimating the level of expertise that it takes to professionally assess most research. It wouldn't be unusual for there to be a small handful of people with that ability in the world.

Does it mean that grant money are distributed by people who are unable to "assess most research"?

Re:Andrew McCalip demonstrates synthesis of LK99 by svara on Friday August 04, 2023 @12:22PM (#37002136)
No, because funding agencies use external reviewers who are experts in the field of an application.
Re:Andrew McCalip demonstrates synthesis of LK99 by ivalm on Friday August 04, 2023 @12:27PM (#37002206)
Depends on the level. At the level of congressional appropriation then certainly. At the program manager level then hopefully the pm knows.
Re:Andrew McCalip demonstrates synthesis of LK99 by mcpackieh on Friday August 04, 2023 @09:54AM (#37000080)
> This is simply what post-peer-review looks like.

Peer review was never a substitute for replication in the first place. In this sense we've been "post-peer-review" the entire time.

Re:Andrew McCalip demonstrates synthesis of LK99 by Waterluvian on Friday August 04, 2023 @10:14AM (#37000379)
Only if you’re doing sexy science.

The peer review system is broken but I think we still need some sort of structured system in addition to this “hey world, check this out!” method.

Re:Andrew McCalip demonstrates synthesis of LK99 by jcranmer on Friday August 04, 2023 @11:34AM (#37001434)
There is a new claim or two of room-temperature superconductors published on Arxiv every year: https://nitter.net/peternemes/status/1684483863999827973#m... and yet this is the only one that sets the Twitters afire.

The reaction I've seen from most of the scientists has been pretty negative on the papers. The originals aren't strong papers. The chemistry has issues: https://nitter.net/Robert_Palgrave/status/168545015680691814... (unbalanced equations, starting materials have pretty different element ratios to final products). As for the main claim, note that LK-99 seems to be a poorer conductor than copper wire at room temperature: https://nitter.net/bedoya_pinto/status/1686848392616423425#m... which is the kind of thing that should really cause a record scratch and make everyone go "um, I think you did something wrong there"--it's something that absolutely would be caught in peer review.

Re:Andrew McCalip demonstrates synthesis of LK99 by notfish on Friday August 04, 2023 @11:55AM (#37001736)
I’m not sure I understand your point. Are you trying to say that people shouldn’t be paying attention to this? I would personally be horrified if I found out that the paper on the synthesis of a room temperature superconductor went through the normal peer review process instead of letting the world know they discovered something huge.
Re:Andrew McCalip demonstrates synthesis of LK99 by jcranmer on Friday August 04, 2023 @12:35PM (#37002331)
My point is why should this unreviewed claim of ambient condition superconductor be exalted as the holy grail and all of the other unreviewed claims of ambient condition superconductor languish in obscurity when they come out? It's definitely not for the strength of evidence!
Re:Andrew McCalip demonstrates synthesis of LK99 by marcosdumay on Friday August 04, 2023 @01:48PM (#37003360)
It's pretty much due to the strength of evidence.

There is no conclusive proof that this is a superconductor on the replications, but the evidence has been on a different level from nearly everything else you'll find on Arxiv since the beginning.

Re:Andrew McCalip demonstrates synthesis of LK99 by jcranmer on Friday August 04, 2023 @02:00PM (#37003504)
AIUI, things that float in a magnetic field at ~room temperature are moderately common claims, and this is really the only evidence that LK-99 might be a room-temperature superconductor. The published ancillary evidence in the original paper actually raises red flags that isn't a superconductor--the "0 resistivity" domain in their temperature-dependent resistivity plot is (when you realize the units they're using) actually slightly less resistive than regular copper wire, which suggests that the sharp drop in resistivity may be nothing more than a pedestrian phase change in the material.
Re:Andrew McCalip demonstrates synthesis of LK99 by marcosdumay on Friday August 04, 2023 @02:28PM (#37003878)
> things that float in a magnetic field at ~room temperature are moderately common claims

At monopolar magnetic fields weak enough to come from a permanent magnet is a lot rarer.

Almost all superconductor claims come from measuring magnetic resonance or direct resistance measurements. Both are noisy things to measure, and won't get you reliable results.

Re:Andrew McCalip demonstrates synthesis of LK99 by likpok on Friday August 04, 2023 @01:31PM (#37003142)
Your link sort of hints at the reason, I think. There's enough posted to make a serious run at replicating it, and it seems to be simple enough that you can do it in a kitchen. At the same time, it's not so easy that people have cleanly demonstrated it -- the constant rollercoaster of "we're so back" and "it's so over" I think drives some of the hype.

It also seems like it has at least pretty strong diamagnetism, which while not a demonstration of superconductivity is both somewhat interesting and gives a vivid demonstration that's amenable to social media.

Re:Andrew McCalip demonstrates synthesis of LK99 by lamontcg on Friday August 04, 2023 @12:24PM (#37002170)
> top tier research will probably get published on youtube and arxiv in the future...

"Top tier science" is already published on arXiv.

The future happened back in 1995 or something like that.

> Quantity, not quality is king.

No, quality is still king. We don't need videos of flakes standing on their end we need someone who has been working with superconductors all their lives who is competent enough to measure zero resistance across the sample. If one of the wild theories is right we need someone who actually knows how to prove it and not just sound like they're intelligent by talking about 1-d superconductors.

Re:Andrew McCalip demonstrates synthesis of LK99 by marcosdumay on Friday August 04, 2023 @01:38PM (#37003234)
> Quantity, not quality is king. Anomalies are drowned out by large samples.

Yeah, that's not how it works.

At practice, anomalies are hyped into everybody's attention, and large samples are drowned out by lack of novelty. You don't need questionable methods to get bad results, you just need quantity.

All the things that are happening are great, and this may be an astonishing discovery. But don't put more certainty on it than it's warranted.

Re:Andrew McCalip demonstrates synthesis of LK99 by codethief on Friday August 04, 2023 @02:09PM (#37003597)
> Instead of a few anonymous peer reviews, you get the entire planet to replicate.

Notably, peer reviews typically don't involve reviewers trying to replicate the results. So we've essentially skipped peer review (at least temporarily) and went full speed ahead with the post-peer-review process.

Re:Andrew McCalip demonstrates synthesis of LK99 by Accujack on Friday August 04, 2023 @02:40PM (#37004027)
>This is simply what post-peer-review looks like.

No, this is a new face for peer review. Existing peer review processes have stagnated in the information age, possibly with good reason. There are a lot of advantages to more immediate review of papers and data, and also to bypassing the systems of qualifications presently used to choose who is a valid reviewer.

Re:Andrew McCalip demonstrates synthesis of LK99 by lumost on Friday August 04, 2023 @09:31AM (#36999773)
Speed is correlated with execution quality. All else being equal, A lab which is better equipped - with better access to materials, and motivated and competent researchers will deliver before the equivalent lab which is deficient in any of the above.

A twitter post isn't peer review, but it is a nice way of sharing part of the process. A video etc. will help others in their attempts to replicate.

Re:Andrew McCalip demonstrates synthesis of LK99 by moolcool on Friday August 04, 2023 @12:59PM (#37002663)
> If I was an academic working on this, I would be following the Sagan Standard and triple checking my results before claiming anything.

Counterpoint: It's better that a lot of people know "Hey, we might be onto something interesting here" early on.