I can't imagine how frustrating that can be. And then you have to do it with something you don't even know works. Kind of like dealing with obscure retro computers. Does it still work? No one knows. What does it do if it works? No one knows. Can it even function or are parts missing? That's right - no one knows.
It is why I quit experimental physics.
Filament is too wet, the air is too cold, a batch of filament might behave wrong. Or everything goes 99% right and the axis of the moon and the constellations are off and it ruins your entire print after 57 hours. Then you start again and it breaks at 59.5 hours. I’m sure it’s not as hardcore as synthesizing superconductors but the real world is incredibly messy and imprecise.
Usually they understand directly because this is something they can easily relate to.
It's still a failure to produce a part that matches the full design.
Samsung 3nm had a yield rate well below 20% back in early 2022, and that's not unheard of while still in the development phase. To be economically viable the yield rates have to be around 80%, so mature nodes can be expected to be in that ballpark.
Everything from humidity and altitude to undocumented "magic tricks" (eg baking something in an oven under vaccuum for a week to get.rid.of.all.the.water.)
I heard anecdotes that experiments were sometimes literally only reproducible in one exact lab because reasons.
Turns out there's just as much art as there is science in experimentation...
It's rare for researchers to get the budget to replicate someone else's work - this case might be one of the few exceptions given that everyone and their dog want to be the first one to show the world a successful replication. Hell, there are Youtube and Tiktok streamers on the task as well, that way you know just how nuts everyone is going.
Oh, you want to document things well enough that people can build on your work and give you citations eventually. But if you've just demonstrated a groundbreaking technique for Foo and the obvious next step is to test it on Bar, you've got an opportunity to get your lab two papers instead of one, and all you have to do is less documentation?
If a prerequisite of publication in a top tier journal was someone having replicated the work… anyone at all… then the quality of write up would improve dramatically because all the stuff that never gets written up would be written up so that the second lab costs them less money to do the replication work, so the second lab doesn’t spent a month failing because they didn’t bake the powder in a vacuum for a week before performing the entire synthesis under dry nitrogen purge when the methodology just said the powder had been dried and the synthesis was performed at ambient pressure in a zero humidity atmosphere…
For a SciFi take on this see the section "A Note on Governance" at https://eldraeverse.com/2018/05/25/approach-vector-2-2/. Specifically, the "Dean of Evidence".
I would expect pairs of labs to gang up, with one of them giving the other the details so that they can reproduce the result, and the contents of the publication staying more or less the same.
Reason is that everybody wants to prevent others from being able to build on one’s work faster than one can do themselves.
Even if the lab you give more information isn’t run by a buddy of you, having a single competitor is better than having the whole world compete with you.
For example, in this case, people will start cooking all kinds of variations on this stuff to find one that’s easier to produce, allows for higher currents before losing superconductivity, doesn’t have lead in it, etc.
A darker comment: the non-replication of results implies that nobody's actually making use of the science output, and an alarmingly large fraction of unreplicated positive results are simply a waste of time.
The super power of modern technology is the ability to perform follow precise steps on a massive scale and basically forever.
Obviously it takes a lot of effort to keep the machinery running but still, the mere fact that it's running in the first place blows your mind if you think about it.
Modern Machinery multiplies the impact on the world of any human who operates it.
Industry is all about doing it cheap, consistently and at scale. So by comparison you don't want any flourish or special conditions that take lots of practice and super skilled operators.
The magic of industrial engineering is figuring out how to go from research to scale. But the flipside is all the crazy stuff that is achievable at the frontier that never gets productionised
vacuum oven also works great for drying 3d printer filament!
That wasn't my experience, in either high school physics or undergrad electronics. I hated keeping a lab book (just wanted to 'do' & see results I suppose) but the emphasis was always on recording as much as possible to understand what's important and what happened etc. when you review later.
I suppose looking through another lens you can call that an expectation of repeatability, but it's just a matter of emphasis isn't it? You know it might be hard to repeat, so you record as much as possible about the setup & process to remove variables and control what needs to be controlled (especially if you don't yet understand what that is, or the full scope).
It might be naive, but I would love an environment where everyone self published or arxiv papers/reviews/datasets/models. Then journals could publish the best papers/review preprints.
I imagine a world where journals beg researchers for the rights to publish their paper after seeing an excellent preprint. Or a journal finds an interesting comment on PubPeer and pays for the author to expand it into a more detailed review.
It will take a while before academics and systems upgrade skills and infrastructure. When they do, I am excited for enhanced capabilities like continuous science. Imagine a website with a study result with P values which continuously update as data is published and integrated into the existing analysis!
https://towardsdatascience.com/continuous-science-6b5ed833ab...
Science is generally dealing with more data than any one person can look at. Anyone with a laptop can provide unique analyses of the data which can fuel new hypotheses, which can be explored with simulations and further analysis.
the big machines represent a bottleneck only in the physical experiments that they enable, but a lot of science can be done around that.
Tighten the feedback loops by all means I say
Especially for public science, but that’s another story
The first paper submitted is titled "The First Room-Temperature Ambient-Pressure Superconductor." It lists three authors: Sukbae Lee, Ji-Hoon Kim, and Young-Wan Kwon. Its timestamp is Saturday, July 22, 2023 at 07:51:19 UTC. [1]
The second paper submitted is titled "Superconductor Pb10−xCux(PO4)6O showing levitation at room temperature and atmospheric pressure and mechanism." This paper lists six authors: Sukbae Lee, Jihoon Kim, Hyun-Tak Kim, Sungyeon Im, SooMin An, Keun Ho Auh [2]. Its timestamp is Saturday, July 22nd, 2023 at 10:11:28 UTC, or two hours and twenty minutes after the first paper.
In both papers the first author is Sukbae Lee and the second author is Jihoon Kim, and in both their affiliation is given as "Quantum Energy Research center, Inc." in Seoul. The first paper posted has Young-Wan Kwon as third author. The second paper does not have Young-Wan Kwon as an author, and has four additional authors with various affiliations.
The second paper appears to have been was prepared in LaTeX, and the first paper appears to have been prepared in Word. The title and abstract of the first paper explicitly claim the creation of the world's first room temperature and pressure superconductor. The title and abstract of the second paper don't explicitly claim demonstration of the first superconductor, though they use some terminology that sounds like superconducting properties.
The accusation is that Young-Wan Kwon published the first paper without the consent of the rest of the LK-99 team, listed himself as third author, and left off the other four. Two hours later, the rest of the LK-99 team stuffed as much as they had into the second paper, and released it as soon as possible.
To me that totally seems like what happened. It explains why there are two different papers from the same group submitted on the same subject on the same day, and it explains why the author lists are different between the two. I haven't yet looked in detail, but I'm betting it also explains a lot of the oddities that people have noted in the first two papers.
This also makes me way more excited about the possibility these claims are legit. The information so far is consistent with a research group that was forced to publish early, and who produced a superconductor through a fabrication process that is a bit tricky. There's nowhere near enough evidence to conclude LK-99 is a room temperature superconductor. But one failed replication doesn't prove LK-99 isn't a superconductor - if the fabrication process is finicky we'd expect to see a few dozen failed reproductions and a few successful reproductions
Side note, the upvotes on the original comment have pushed me well past the 500 upvotes mark, so now I have a downvoted button on most comments. Which is actually kind of annoying on mobile because God, they are right beside each other and absolutely tiny, with no remaining visual indicator afterwards as to whether you upvoted or downvoted a comment.
A new link appears on that comment with text `undown` or `unvote` depending on which one you clicked.
Creating a dish, replicating the dish, writing a recipe, getting competent cooks to follow the recipe, getting non-competant cooks to follow it, and so on. [1]
It all leads to multiple revisions and takes a lot of time.
And this is for -food-. Imagine doing it for something a lot less tolerant of variation.
[1] old recipes start with "pluck 2 chickens" because, you know, someone followed the recipe and didn't pluck the chickens...
TLDW it seems very unlikely that they have what they claim
Plenty of people who know the theory of superconductors are sceptical. They're not wrong about the theory. It's also worth pointing out that every previous time a new superconductor critical temp limit was broken in a major way, superconductor theory saying it shouldn't be possible was a cause for early scepticism amongst those who knew the theory. Sabine's gut reactions in a YouTube video doesn't make the result very unlikely. It doesn't make her wrong either, she's right that all existing superconductors, if pure and homogeneous, would not behave like that on a magnet. It is also the case that all existing superconductors do not superconduct at room temperature and ambient pressure. It is also the case that (absent fraud, which is on everyone's mind after Ranga Dias) we don't know of any material that could plausible behave the way that video shows something behaving. The only thing I can think of that could behave that way would be impure/heterogeneous diamagnetic material, but like 15x as diamagnetic as the next highest non-superconductor, which means if that material exists we don't know about it. If it was fraud, it would be with a magnetised sample on a magnet like that. The reason I think fraud is the only option if it was a magnetised sample is because that's a really, really obvious explanation for the effect and they have to have measured the sample for magnetism before putting it on a magnet. They would also literally feel it/see it/hear it while placing the sample on the magnet. Also it would almost certainly have to be composed of different elements than they describe, because lead apatite with copper definitely should not be ferromagnetic at all.
As I understand it, the 99 in the name is because they first discovered it in 1999.
Seems to me that if you didn't manage to nail down the process in 24 years, it's probably time to publish and let someone else have a go.
Humans really are selfish sometimes.
But if I was an early-career researcher looking to establish myself, secure funding and maybe a tenure-track position, and I had a nobel-prize-winning discovery up my sleeve, I can't imagine many things that would take precedence.
I mean, obviously whatever happened happened. It just seems strange to simultaneously claim to have discovered something 24 years ago, and to have been rushed into publishing prematurely.
They had to get other jobs to survive. Somone else forced their hand with the publication. There's nothing incosistent about that.
Probably there was a big team. Somebody with a low rank worked his/her ass off on the breakdown, but then noticed their names would be filled off or put only in acknowledgements section, to be replaced with some senior lab manager that did just administrative paperwork and barely knew the work. So they said screw it and just published whatever they could before the laurels were stolen.
Take a video of you producing and testing it, with a mobile phone.
It only works 10% of the time? Not an issue, post 10 videos. Whatever.
Would it be perfect? No, of course it could be faked.
But i guaranteed people would be a ton less skeptical and willing to push hard on this if the original authors had done this sort of thing.
It's honestly not that hard to set up a tripod and a mobile phone, and even in the circumstances here, where they apparently got pushed to publish quickly, it could still show that it works.
It also would help those trying to reproduce see exactly what you did, in detail.
Worse yet, I can with a bit of trick photography and standard liquid nitrogen cooled super conductors make a video that looks like success even though I'm working with colored wax for materials in the production process. (liquid nitrogen is hard to disguise, but with some trick photography and multiple takes I can do it). Or I can skip all that and spend some time in blender to do the above via CGI. (well I don't know blender that well, and most blender animations are obvious, but someone with a few months could pull this off)
It is not that hard or expensive to record footage for a few days at a time having a continuous overwrite.
You likely don't even need to go that far -Most universities have cameras everywhere, anyway, including plenty of universities that have cameras in every lab of this kind.
It is also done by millions of home users all the time.
As I said, yes, things can be faked, but who cares that’s not the point
Can confirm from my life prior to working with computers.
“Is this mortar and pestle actually clean?”
“How much grinding is the right amount?”
“Is the window open or closed?”
“Did someone fuck with the settings on this machine since I last used it?”
And so on…
What percent of the cost of running these experiments do you think that is to buy a nest or a unifi camera? Heck, Do you believe the university doesn’t already have a surveillance system almost certainly in the hallway to the lab. Plenty of them even have cameras in every lab already. In the past two weeks, I was in three material science labs in Georgia, and South Carolina and all of them had cameras in every lab.
This is not that hard. If you wanna argue that it’s not helpful, that’s one thing. But arguing that it is difficult seems very silly.
Your aspiration, I suppose, is that this (e.g., surveillance?) video will document the experimental activities in enough detail so that they can be replicated and/or convincingly proven. As a practical matter, it's ludicrous to think that any of the examples that you suggest as obvious and trivial would do either of these things much less survive a cursory consideration of their cost/benefit.
Further, this is a classic example of premature optimization. Should only labs that are confident that they will be contesting for a Nobel prize be monitoring all their experiments or do you also envision this as an activity for labs with lower aspirations or self-esteem?
If you want to know, maybe, you know, ask ("Have you ever tried to do this before in a lab?" - this is also not hard, and even the people not contending for the Nobel prize can do it), rather than just assert that this is just something i only want to see others do in my imagination, which is not just rude, but actually, it turns out, wrong.
But hey, don't let that stop you. Please, continue to assert things about me rather than actually ask or otherwise use means that might gain knowledge of me and what i have or haven't done.
To answer the rest, so, actually, no, that's not my aspiration. My aspiration was "producing and testing", specifically targeted at "early stage believability". Which is what I said. You seem to have decided that means "be able to show all pieces in a convincing way" or "make a how to video". That would be silly, which is why i didn't say that.
This is is mostly about showing a video of the end result in a meaningful way, as the literal top thread on this on HN now does, posting multiple reproduction and testing videos. If you can show production in some way at all, awesome. I'm not interested in the residents cynics shitting on every single way that it could be faked, nor are most other people.
To most people, those videos are much more convincing than all the papers and anything else you produce.
As for who monitors, as I mentioned elsewhere, lots of labs already have cameras, because universities now put them in almost every room. As I mentioned, I was even in multiple material science labs in the past week, and all had cameras. But please, feel free to continue to pretend that this is some super complicated thing to do when it's already being done and being used to good effect, convincingly, on HN, right now.
I guess they all just contending for a nobel prize, because otherwise, this is clearly impossible, despite it literally having been done.
Do you think that it would be easier to replicate the LK-99 process if video from a corner of their lab existed?
OK. I want to know - have you produced compelling video of a controversial experiment in a lab using the pre-existing security cameras? And did that video quiet any critics?
As others have pointed out the idea of using video as strong evidence is underbaked.
I didn’t say strong evidence, I said evidence.I was, in fact, quite clear that it is not strong evidence. you seem to have added that so that you could be more dismissive.
Secondly, this all happened two days ago! If the methodology was perfect, I still wouldn't expect good replication results back within two (part non-business!) days.
I don't know if this material is legit. I really hope it is. But the process of figuring that out could potentially take months (or more), and a two-day-later failed to replicate is not a death sentence.
As much as it sucks, this is really just going to take time to prove it's not a superconductor. If it is a superconductor, we may not know for a while either, unless one of the influencers/"makers" attempting to reproduce the material succeeds and posts some good convincing video of flux pinning or other Meissner effect stuff (that person is going to go insanely viral, if it happens).