The scientific (and then, industrial) revolution didn't begin until researchers started sharing their results in open literature form, or at conferences, or within bodies like Britain's Royal Institution. Dissemination of knowledge is absolutely part of science.
Similarly, a fundamental necessity in science is independent replication of results, and that's definitely not possible with closed secretive research done in the alchemical mode.
There are many examples, such as the secretive public-private DOE FutureGen program aimed at "zero-emission coal-to-hydrogen plants" which wasted about ten billion dollars over twenty years with nothing to show for it (and whose data is still not available), the Trofim Lysenko plant breeding program in the Soviet Union which wrecked Soviet agriculture for decades (and falls into your latter category) and so on.
Another example could be the Challenger Space Shuttle disaster, although that's more an engineering failure than a science failure, but it had similar underlying causes, i.e. managers pushing engineers to go along with a flawed protocol.
Science is knowledge. The etymology of science is to split stuff and understand how it work. But from late 14c in the more specific sense of "collective human knowledge".
"Private" science is not science. It's some esoteric stuff.
"Public" science is just a special case of "restricted" science, such that the set of people the knowledge is restricted to is equal to the set of all humans.
An essential part of doing science is sharing results and waiting for others to challenge, expand, or falsify them. If you skip this step, you're not truly contributing to knowledge, although you may still create new knowledge in other ways... but not all new knowledge is necessarily scientific, it can be private, esoteric, commercial knowledge.
Take the example of Ida, a 47-million-year-old lemur fossil known as Darwinius masillae. https://en.wikipedia.org/wiki/Darwinius it was "discovered" and hailed as a transitional species bridging primates and mammals. Really a huge contribution to "science".
But here's the catch - Ida was actually found in 1983 and held by a private collector for 25 years, who didn't realize its significance. So we had no idea of this "discovery". It wasn't science, it was a good on a market.
OpenAI is the same. We might enjoy to toy with the technology. But I don't find it contributed to science, yet
Let's say that there was a highly advanced civilization that existed way before the current civilized society. They performed scientific experiments and gained a lot of insight, but a catastrophical event erased them from the face of Earth together with all their knowledge.
Did that civilization engage in science?
If you think that they did, indeed, engage in science, then what is the difference between them and any other closed community that performs scientific experiments?
Or, if you think that they didn't, in fact, engage in science, then does that mean that science is only science if you and I, today, can gain access to the knowledge derived from the experiments? Therefore, science is defined by its utility to us?
This thought experiment seems to introduce a huge variable which eliminates what I think might be a key factor in what many readers believe to be the practice of science.
> what is the difference between them and any other closed community that performs scientific experiments?
That difference here, and the key factor, would be intent. The catastrophic event eliminates any meaning behind what they accomplished or practiced in regards to why they practiced science in the first place.
Practicing it behind closed doors may appear less like science for science's sake and more like, say, an economic pursuit that coincidentally involves the scientific method.
That could be why the conversation appears so split at the moment. It's hard to claim science is about intent or a long-term purpose that, were it removed, it would bar a scientific activity from actually being Science proper. That's a very subjective thing.
But if they didn't suffer a catastrophic event, we would call their activities "science"? So, because they did suffer a catastrophic event, what they did is not science (or is not relevant, since you avoided answering the question directly)?
And if our current society was destroyed tomorrow in a catastrophic event along with all our science, and a new society arisen from the ashes that performed scientific experiments, would that mean that what we did wasn't science? Or that what the new society is doing isn't science?
I know I'm streching things here, but words (should?) have meanings in all possible scenarios, and thought experiments are used to decide meanings in such edge cases.
> Practicing it behind closed doors may appear less like science for science's sake and more like, say, an economic pursuit that coincidentally involves the scientific method.
Does "not doing science for science's sake" include only monetary motivation? Would it also mean that someone who primarily wants to achieve status and fame as a scientist also isn't doing real science? Or are they exempt from the rule, since they would most likely release their knowledge into the public (which brings us back to the "science is only science if the current society benefits from it")?
Take, for instance, the Greco-Roman mix for concrete. They produced that scientifically, repeating experiments with their volcanic ash-filled cements to make the best they could, and shared those results across their territory. While that knowledge was lost for centuries, it was still science.
However, a cement company producing a better product and not sharing the production is not science. It’s an economic pursuit. Its goal is not to help everyone to produce a better product, but to produce a better product and hide the results. Even if it uses most of the scientific method, if it doesn’t share its result its not science.
And no, monetary stake isn’t the only reason someone may not be doing science properly. A major one we see time and time again is the desire for science-based renown.
For instance, Einstein is renowned for being one of the smartest men alive, who shaped a lot of our modern understanding of the universe. He may ultimately be wrong, but we have yet to prove that and in fact continue to prove he was decades ahead of his time.
Contrary to Einstein though is Edison, while he did do quite a bit of real science, he was less focused on actually advancing our knowledge and more focused on his own image. For instance, he invented the electric chair solely to try and slander Tesla’s AC, and tortured animals in public to try and breed fear.
Additionally, I will throw my hat in the ring and say most of modern academia doesn’t pursue science, as they push for ever-restricting holds on scientific papers in the pursuit of financial gain. While simultaneously depriving the actual researchers any of that gain, money which could surely help raise a lot of institutions into doing more effective research. Instead, they profit off of and restrict the free flow of knowledge to line their pockets, disabling millions of researchers worldwide from accessing it and imposing harsh prices on non-academics who wish to learn.
In the end, when it comes to what is and isn’t science, I will posit a question. If you never heard about it, and can’t reproduce it yourself/watch someone reproduce it, did it really happen? Or has “science” evolved from the pursuit of knowledge to a faith? If we blindly trust the people in power that they are right, and punish those who question their assertions, it can only end in destruction.
OpenAI, even without saying how the model works, has been hugely influential in science.
If science happens behind closed doors but we witness what it makes possible, that influence alone can inspire a lot more effort and discovery with or without the data that lead to the accomplishment.
I think that moment has been profoundly influential due to ChatGPT alone.
Whether or not it's a good thing that it's largely private is very difficult to say. I don't feel great about it, but I also don't think I know enough to have strong opinions yet.
Edit: I mean, c'mon - the final step to the scientific method is "communicate your results". I'm surprised this requires explaining.
You're right that "OpenAI is not doing science" was hyperbolic, but I tried to clarify the aspect of science that I'm referring to.
For example, at minimum psychology, epidemiology and climatology have this problem. In climatology attempts to get the source code of models and data underlying papers has led to some of the biggest dramas in the field e.g. the Climategate hacker appears to have been motivated by the closedness of the field (similar to the llama leaker).
Given that society is clearly not ready to reclassify large parts of academic work as non-scientific, it seems like this definition cannot work even on its own terms.
What? OpenAI is absolutely conducting science amongst themselves. They are certainly engaging in the hypothesis -> test -> result scientific method, which is science in its purest form. Sharing the secret sauce is what is done or expected in academia, but that doesn’t mean that OpenAI isn’t conducting science behind their own walls. You’re conflating institutional academia with the scientific method.
If I go home and test the boiling point of water in my garage and record the result privately without publishing a paper, am I not conducting science? What nonsense.