What are the old names for these ideas?
Besides, Stephen's approach here is to ignore 15-20 years of research from various CS sub-communities; his best case scenario is spending a decade reinventing that wheel. The problem with cross-talk that isn't "humble on both sides" is that it's either a) a waste of time because one side's ideas aren't that important, or else b) a waste of time because one side has to reinvent the other wise.
In terms of "humility on both sides", it's such a common theme that this oft-cited assumption is taken as truth. Some of the greatest minds who had the most impact in our history were also insufferable assholes, who were stubborn and would not yield until people were forced to reckon with their ideas. Is this me defending Wolfram's ideas? No. But it's me defending the idea that "humility and civility" as a prerequisite for scientific advancement seems false, and in fact, in stagnant fields, the need for a disruptive personality who happens to be right may be perhaps the only real way out of the rut.
The problem, in the very particular case of this blog post, is that the cost for lacking intellectual humility is spending time reinventing other people's wheels. And those wheels won't get him as far as he thinks they will. We know because they've already been built by others.
I think we should separate:
- Wolfram acting as though he thought of the ideas first
- Wolfram being underinformed so as to undermine his own progress
People typically get bent out of shape on the former, which is in evidence, and is a problem of politics. The latter, we can't prove or disprove unless you see him drawing significant conclusions that are falsifiable via current understanding. If that is the case, then I'll yield. But I suspect Wolfram may be more well read than he lets on, but for whatever reason, has a dysfunctional personality trait where he sees his own wrangling with ideas already put forth as a form of authorship, when he incorporates it into his long chain of analysis that he's been doing for decades. A potential analogy is one of "re-branding" - but in this case it's re-branding as part of an internal narrative, one where in the final chapter, Wolfram sees himself as the grand author of the unified theory. In that mental model, each idea he draws from is not one he cobbles together into a unified form, but instead, ideas he incorporates and reinterprets in his own bespoke system and methods, leading him to forget that the core ideas are not his own. (I'm definitely reaching here, but trying to to highlight how the two things above could be in fact very materially divergent and consistent with the evidence.)
> Wolfram [is] acting as though he thought of the ideas first.
This is called plagiarism. Independent reinvention is no defense if you keep on acting as though you had the idea first. He has already been informed many times that parts of his work are not original, and his behavior doesn't change.
And he knows it, on some level. He made the decision to communicate his "discoveries" in press releases and self-published books. He knows he's not subjecting himself to peer review. He may know, on some level, that his work couldn't pass it. He sued one of his employees to prevent him (the employee) from publishing a proof that Wolfram claimed he had discovered in his book. https://en.wikipedia.org/wiki/Rule_110
I understand what you're up to in trying to invent a psychology that explains his bad behavior, but at some point you have to withdraw empathy and think pragmatically about consequences. Wolfram's actions are already more than sufficient to disgrace an ordinary academic. He's damaged at least one career that we know of. He tries to pass himself off as a visionary scientist only he never delivers. If he wasn't independently wealthy no one would be listening to him at all. But non-experts do listen, which is precisely why speaking up against pseudoscience is part of every real scientist's professional responsibilities. Rather than spin these theories, it would be a better use of your time to send Stephen some email urging him to stick to working on Mathematica.
The wikipedia article claims that Wolfram conjectured rule 110 in 1985 many years before Cook. Out of curiosity, do you have any info that disputes this?
That doesn't matter much, though. Academics have a lot of ways to deal with priority disputes. Sometimes they author a paper together. Sometimes they each publish separately in the same issue of one journal. That's what happened when Darwin and Wallis simultaneously developed the theory of evolution. Sometimes, if the first discoverer was much earlier than the second, the second author might publish the work, and make a public statement in the paper saying the first author was first. This is what happened when Claude Shannon invented information theory only to learn that Norbert Wiener had done the same thing twenty years before. If Wolfram had documentation of his claim, some compromise could probably have been worked out.
Instead, it's a matter of public record that he sued Cook, alleging that the knowledge that Cook had done the work was a trade secret of Wolfram Research. I said before that scientists get paid by correctly being assigned credit for their discoveries. Suing to prevent a scientist from taking credit for their research is like armed robbery. There had been some grumbling before, but this was the moment when scientists recognized that Stephen Wolfram was Not A Real Scientist Anymore.
What specific literature are you referring to?
> Everything in physics and physical reality must have a digital informational representation.
Can you go into a little more detail about the other versions of these ideas? What are they called in other theories?
What are the names for these old, well-studied things in programming language theory, so we can look them up?
I've decided that I do not have the time or interest in writing the Related Work section for a paper-length blog post touching on an enormous number of fields, some of which I know well and some of which I haven't thought about in a decade. (As an aside, one real and substantive problem with trying to build a research program without taking the time to share a survey and comparison with related work is that you'll have difficulty communicating with others. It will then take extra effort on others' part to build up a knowledge base. Surveying and comparing to related work is hard and thankless but important work. It's not about credit, it's about building up a shared knowledge base.)
However, I can spare an hour or two and take the time to flesh out one or two in order to demonstrate what I mean.
So, I'll make the following offer: is there any particular excerpt from Stephen's blog post to which you would like the CS/PL/info theory analogue? Or, would you prefer me to pick a particular sentence and identify the body of work that explores that question and the major results of that body of work? (I will take this opportunity to emphasize the "about the non-physics side of things" portion of my original post.)
I'm going to link to this thread in other places where people have asked this question instead of monitoring 3 or 4 different threads going forward. I'll do my best to occasionally monitor this thread for requests and do my best to reply. FYI, I probably won't get around to answering more than one reply until the weekend.
I don't understand how things could be extremely well studied and developed, but also not exist in some fashion where you could just name and link to it in a matter of minutes rather than hours. Example "emulation cones are called X here".
I've listened to Wolfram and skimmed one of his books before deciding he's beyond my ability to evaluate as genius or crackpot. I'd love to be able to nail down a specific thing where I could read about some existing topic and then read about Wolfram claiming to reinvent it or something, because that could help me learn towards one conclusion over the other in the genius versus crackpot consideration.
One frustrating thing that I often find is that much of Wolfram criticism is non-specific and as it's impossible for me to bucket Wolfram I can't bucket his critics either because they tend not to provide enough detail or clarity.
Emulation cones go by various names, but perhaps the most common is the (bounded) reflexive and transitive closure of a reduction rules of a system. Another common name is the (bounded) reachable set.
Rulial spaces, by which I mean the particular ones Stephen seems interested in toward the end, are higher order term rewriting systems or higher order syntax. But actually, rulial space is used throughout the text in a much more general sense. I'd consider even very canonical results from PL theory, e.g. confluence of rewriting, to be non-trivial observations about a particular rulial space.
The reason for giving (or at least very vaguely hinting at) a definition for rulial spaces and emulation cones is to talk about foliations and then expressiveness. There's some connection between foliation and bisimulation that's difficult to exactly nail down, because nailing it down requires a lot more precision about the exact sort of (emulation cones we are interested in and for which) spaces. The connection between expressiveness and complexity hierarchies is immediately obvious, I think, right?
> One frustrating thing that I often find is that much of Wolfram criticism is non-specific and as it's impossible for me to bucket Wolfram I can't bucket his critics either because they tend not to provide enough detail or clarity.
Oy, no good deed goes unpunished :)
Look, I get why it's frustrating.
But, really, there's a reason that rule #0 of technical writing is to define terms before using them. The reader can only do so much.
If these concepts don't have a single name that you can just rattle off, and that we can Google - if describing them in terms of existing theory would take serious effort - then surely identifying and naming them is a major contribution?
Maybe you could advise some developed language or model for this task? The interesting part is to have code-data duality and enough rich language to kick start natural selection that would produce competing algorithms that would gradually become more and more complex (and gradually become closer to sentience).
Though the language might not even be Truring complete as it is. As natural assumption would be that the model should be finite in resources and it can get access to infinite time or memory only in time limit (assuming that the individual algorithms would survive for this to happen).
>For example, his "emulation cones" are a new name for a very old and extremely well-studied idea. The term "rulial space", similarly, is a new name for an idea that's well-developed in programming language theory.'
What's the old well-studied idea, and the well-developed programming theory idea? A one sentence reply is fine.
"However, were the book more cautious in its claims and more willing to acknowledge previous work, it would likely be easier for readers to assess what it does offer: a cellular-automaton-based perspective on existing ideas in science"
In order to be useful, this model should either create a new testable prediction or speed up computations in existing models while retaining accuracy. It seems to be in the latter camp. I would like to understand more about why this model is more computationally efficient.
Perhaps there’s more work to be done on the process of generating rules or limiting the types of rules. Arbitrarily choosing rules to create properties that look similar to observed physical properties doesn’t seem to point to a fundamental theory.
The article suggests that working out the theory of something like rule production systems, and then figuring out how that theory relates to existing insights from physics, is the best path toward a Fundamental Theory of Physics.
My primary source of skepticism stems from the fact that the theory of rule production systems is not exactly a new area of study. It's been well-developed at various points in time and from various perspectives by the theoretical CS, programming language theory, automated theorem proving, and mathematical logic communities. That theory addresses most of Stephen's "big difficult questions" about the non-physics side of things. For example, his "emulation cones" are a new name for a very old and extremely well-studied idea. The term "rulial space", similarly, is a new name for an idea that's well-developed in programming language theory.
I sympathize with Stephen. In fact, he sounds a bit like I did early in my scientific career. Unfortunately, though, I just don't see how these old well-understood ideas from computer science are going to result in a new fundamental theory of physics.