So, the most controversial aspect of pilot wave theory is the idea that a classical system can reproduce some phenomena considered only to arise in a quantum one. The 2006 result was important because it appeared to definitively prove a classical system could do just that, and for one of the most famously “weird” quantum results. How accurately it correlated with a hypothetical pilot wave based quantum reality wasn’t really relevant. And if the original result was important, then the failure to reproduce it is also important.
More generally, scientists can argue about theory, mathematics and the “deep” stuff until the cows come home. But what actually advances science is experiment. It may not always be the most glamorous or exciting work (CERN notwithstanding). It can be an expensive, years-log slog to add a single negative data point against an idea a theoretician dreamt up in an afternoon, and which they’ll dismiss as irrelevant, or avoid by tweaking a single equation. But it’s, quite literally, the part of science that gets results.
Edit: I love that there's a segment of people in the QM community approaching these "very serious" thought experiments like Schrodinger's Cat (as the classic example), instead using absurdism to produce equivalent but blatantly ridiculous results. Like the Surrealist reactionary art movement but with the often insane results QM produces. Sometimes I think string theorists need a group kind of like this too.
The subhead seems a tad sensationalist. If interference had been shown, it would have suggested strongly that this can happen at the smaller scale as well, and that it didn't is probably disappointing for those that hoped to show it in the analogy. Not sure how it "crushes" those theories.
When I saw the droplet experiments, I thought "that's cool, but it doesn't prove anything about pilot wave theory because the arguments are over much deeper things than what this is demonstrating". Debunking it is just as meaningless. The people who actually know about this stuff are arguing over determinism and non-locality and what not. I thought oil droplets are just a nice way to introduce people to the concept.
Disclaimer: I don't really know anything about any of this