News for hackers. Stuff that matters.
Re:Complexity Explained by hliyan on Saturday February 06, 2021 @09:10AM (#26046582)
I recently had the (possibly flawed) epiphany that all behavior is emergent. If you think about it, all things that we consider objects are just semi-permanent aggregations of fundamental particles that we recognize and label as objects for convenience of thought. When the patterns in such aggregations are outside the space and time scales that allow human minds to recognize them, the only label available is "complex".
Re:Complexity Explained by jameal on Saturday February 06, 2021 @09:27AM (#26046689)
I'm curious how this epiphany came to you. This strikes me as very similar to the Buddhist concept of the Five Aggregates, which describe five elements that combine to make up our existence: Physical form -> Sensation -> Perception -> Mental formations -> Consciousness
Re:Complexity Explained by hliyan on Saturday February 06, 2021 @09:35AM (#26046745)
I was just trying to understand what people mean when they say that "consciousness is an emergent property", which always felt like a hand-wavy explanation. I was weighing that explanation against panpsychism and then this thought emerged.
Re:Complexity Explained by JoeAltmaier on Saturday February 06, 2021 @09:38AM (#26046753)
I'm wondering which sort of consciousness is under scrutiny. We know when we're conscious and unconscious. E.g. Awake vs Asleep. Even animals exhibit that dichotomy.

The other consciousness is self-awareness. Which is hard to detect from the outside. Some animals may have it. Do they understand when they look silly? Do they recognize themselves in a mirror? These may be diagnostic.

It's important to know which one is intended since they are so very different, at least in their distribution among living creatures.

Re:Complexity Explained by Smaug123 on Saturday February 06, 2021 @10:20AM (#26047082)
> We know when we're conscious and unconscious.

I claim that this is not true as stated. The main bulk of the habit-forming nearly everyone needs to do when learning to lucid dream is to recognise when you're dreaming, because almost nobody natively knows when they're dreaming. You have to learn to spot it by paying attention to the things which the dream machinery is very bad at (like text, clocks, and your own breathing).

Re:Complexity Explained by JoeAltmaier on Saturday February 06, 2021 @10:24AM (#26047123)
Sorry, I meant 'we' as an observer. Should have said "its clear from observation " perhaps.

Anyway good point.

Re:Complexity Explained by zikzak on Saturday February 06, 2021 @09:57AM (#26046898)
https://en.wikipedia.org/wiki/A_Guide_for_the_Perplexed

I discovered this book in my early teens and it helped me in structuring my thinking about this sort of thing.

Re:Complexity Explained by hliyan on Saturday February 06, 2021 @09:43AM (#26046793)
Awareness, definitely. I'm using consciousness in the same sense Julian Jaynes used it (he used to call the other form "reactivity", a term that never quite caught on).
Re:Complexity Explained by airstrike on Saturday February 06, 2021 @10:42AM (#26047239)
> and then this thought emerged.

I see what you did there...

Re:Complexity Explained by beaconstudios on Saturday February 06, 2021 @09:51AM (#26046857)
This is the reality of bottom up organisation, and is basically a completely different metaphysics to the current Western modernist one. Going further down this path of thought will lead you to ideas like constructivism, teleology, and non-dualism - all ideas that have long philosophical histories but are currently out of vogue.
Re:Complexity Explained by ReactiveJelly on Saturday February 06, 2021 @10:00AM (#26046932)
It would be nice if someone could untie them from religion, make them simpler to understand, and bring them back into vogue, if they're so useful.
Re:Complexity Explained by carapace on Saturday February 06, 2021 @12:39PM (#26048214)
Well, there was Siddhārtha Gautama, who became Buddha. His original teachings are non-religious.

I can recommend the books of David Hawkins for a modern, scientifically-informed view on the subjective experience of Reality.

https://veritaspub.com/dr-hawkins/

> Sir David R. Hawkins, M.D., Ph.D. was a nationally renowned psychiatrist, physician, researcher, spiritual teacher and lecturer. The uniqueness of his contribution to humanity comes from the advanced state of spiritual awareness known as ” Enlightenment,” “Self–Realization,” and “Unio Mystica.” Rarely, if ever, has this spiritual state occurred in the life of an accomplished scientist and physician. Therefore, Dr. Hawkins was uniquely qualified to present a spiritual path that is scientifically compelling to modern society.

Re:Complexity Explained by beaconstudios on Saturday February 06, 2021 @10:06AM (#26046971)
There are a few of us out there trying to do exactly that, including the above article.
Re:Complexity Explained by rramadass on Monday February 08, 2021 @08:12AM (#26063946)
It has already been done. One of the oldest Schools of Indian Philosophy called Samkhya (which is atheistic) has a very beautiful model of the Universe/Elements/Evolution of the World which has influenced all other Schools (including Buddhism) and is worth studying.

You might find the book Modern Samkhya: Ancient Spirituality for the Contemporary Atheist a good starting point.

Re:Complexity Explained by fallous on Saturday February 06, 2021 @12:00PM (#26047812)
Is this not similar to the philosophy of capitalism (at least as posited by Adam Smith) upon which much of modern Western thought rests? Arguably it's also very much reflected in John Locke's work as well as many philosophical foundations for democratic institutions.
Re:Complexity Explained by beaconstudios on Saturday February 06, 2021 @12:14PM (#26047957)
yes there are some Western philosophical foundations which treat organisation as bottom-up at certain levels of abstraction - Adam Smith on the economic level, Locke and Hobbes on the sociopolitical level, and so on. I think we have a good cultural understanding of human beings as existing in a network. But we don't consistently apply this perspective. For example:

- individualism treats individuals as good or bad, successful or unsuccessful based on their outcomes without regard for the structural incentives around that person.

- we still categorically divide between "life" and "not-life", treating life (and especially consciousness) as a conundrum and "not-life" as dead matter. We try our best not to look at the fuzzy edges between life and not-life. I would argue that this is a hang-over from Abrahamic dualism (the spiritual inhabiting the material), and that there is no distinction but instead a continuum from less-organised to more-organised. We do the same as the above with many other issues of category.

- Identity isn't concrete in bottom-up organisation. The Ship of Theseus, for example, is not a paradox when you take a bottom-up metaphysical approach. The illusion of identity is only propagation of a pattern.

TL;DR - yes, we do have some ideas around bottom-up organisation, but they're not applied consistently or across the board.

If you think all this sounds like woo, then you are at least in agreement that these ideas are not Western modernist canon.

Re:Complexity Explained by fallous on Tuesday February 09, 2021 @11:35AM (#26079457)
I'm not sure we treat individuals as good/bad or successful/unsuccessful based on purely on outcomes. Criminal law, for example, depends upon intent in many cases.

The general biological view of viruses certainly demonstrate the absence of a categorical divide between "life" and "not life" as does the philosophy of the Turing Test. I'd argue that level of organization is less useful than the level of feedback loops in something, particularly if those loops are internal rather than external.

We daily operate with the idea of the Ship of Theseus as non-paradox in any number of ways. The City of Philadelphia retains its identity not because it is composed of the same people, geography, and structures established in its founding but rather because of the role it plays as an organizational concept, the Mississippi River retains its identity despite course changes over the centuries (let alone the constant replenishment of the individual water atoms within it).

I'd agree that we do not consistently apply bottom-up organization across the board, but that also necessarily means that we apply no consistent philosophy across the board. That leads to the question of how you're defining "Western modernist canon" given such an absence of a unified system.

Re:Complexity Explained by beaconstudios on Tuesday February 09, 2021 @12:09PM (#26079933)
> I'm not sure we treat individuals as good/bad or successful/unsuccessful based on purely on outcomes. Criminal law, for example, depends upon intent in many cases.

I mean the tendency to see someone who is for example a burglar and contrast them with a business owner and say that one is bad and the other is good. Which could be true if you removed all context, but usually when you add in context these kinds of absolutes dissolve. But my broader point is that we make value judgements based on the agent, minus the environment, which is IMO erroneous.

> The general biological view of viruses certainly demonstrate the absence of a categorical divide between "life" and "not life" as does the philosophy of the Turing Test. I'd argue that level of organization is less useful than the level of feedback loops in something, particularly if those loops are internal rather than external.

Feedback loops are the exact kind of organisational structure I was referring to, but I didn't know if you were cybernetically-oriented so left it vague. Loops are the mechanism of self-organisation.

> We daily operate with the idea of the Ship of Theseus as non-paradox in any number of ways. The City of Philadelphia retains its identity not because it is composed of the same people, geography, and structures established in its founding but rather because of the role it plays as an organizational concept, the Mississippi River retains its identity despite course changes over the centuries (let alone the constant replenishment of the individual water atoms within it).

I agree - we certainly act this way, but we culturally value reductionistic thinking; system-2-thinking is typically not oriented in this same way, and is more culturally valued. It's not necessarily how we act that I think is bad - it's how we think.

> I'd agree that we do not consistently apply bottom-up organization across the board, but that also necessarily means that we apply no consistent philosophy across the board. That leads to the question of how you're defining "Western modernist canon" given such an absence of a unified system.

It's our cultural institutions of thinking and understanding that are flawed, IMO. We generally act relatively well when we act on instinct, refusing to draw rigid boundaries and treating our environments teleologically. But in terms of the "right way" to solve problems, we go away from this and towards reductionism and mechanistic thinking (essentially ignoring the small or inconvenient relationships in the systems we examine, in classic "spherical chicken in a vacuum" style). We try to fix malignant systems by looking for the bad people who made it that way (the simplest, and usually most incorrect, approach possible), or by fixing proximal symptoms rather than following longer causality chains for root causes (think medicine - problems are addressed locally rather than systemically).

Re:Complexity Explained by fallous on Tuesday February 09, 2021 @12:59PM (#26080549)
I'd agree that we tend to frame things in a reductionist way, but I don't think that's peculiar to Western thought so much as it is endemic to humans and their limitations. Given limited resources of time and knowledge the vast majority of people either attempt to limit the scope of the problem domain or opt for satisficing behaviors to achieve "good enough" results. It is rare that when confronted with a problem that a person has the luxury of time, creativity, and/or attention to derive first principles. It is doubly difficult when examining systems because the failings of most systems are not immediately obvious but instead the result of unintended consequences or the complexity of multiple conflicting behaviors resulting in perverse incentives... and if at the creation of the original system such problems were not foreseen what guarantees that the replacement system does not create worse results? Most people are cautious in proceeding when they are facing unknown (or unknowable) obstacles.
Re:Complexity Explained by beaconstudios on Tuesday February 09, 2021 @04:43PM (#26082725)
I believe that the toolset that we have created for ourselves for solving hard problems ossifies this limited approach, and that we need to make tools for improving complex systems more widely available/understood. We could even benefit if those in governance roles just knew about second order thinking and how to avoid unintended consequences from linear thinking, let alone any of the more advanced problem solving tools that systems theory provides.

Also I say that it's a Western thing, not because it's exclusive to the West, but because reductionism is part of our philosophical foundations since the Enlightenment. Compare to, say, SE Asian philosophical foundations - SEA religions are typically non-dual and metaphysically idealist.

Re:Complexity Explained by cardoni on Saturday February 06, 2021 @07:07PM (#26051381)
> The Ship of Theseus, for example, is not a paradox when you take a bottom-up metaphysical approach.

What do you mean by, “bottom-up metaphysical approach.”

Re:Complexity Explained by beaconstudios on Saturday February 06, 2021 @08:55PM (#26051910)
if all of reality is just emergent phenomena (excluding some presumed "bottom thing" that we haven't found yet), there is no such thing as an "object" as a coherent whole - just collections of collections of collections. The ship of theseus does not exist as a distinct entity with clear boundaries - it is just the thing that Theseus uses to sail. If you replace every piece, as long as Theseus considers the ship his own then it's still the ship of Theseus, or in other words, identity is perceptual and based on a continuous structure or pattern rather than the present constituent pieces being all together.
Re:Complexity Explained by joe_the_user on Saturday February 06, 2021 @05:29PM (#26050644)
If you are discussing the macroscopic day-to-day reality we human live in, sure, all things and all characteristics-of-things are emergent in broad sense. Every distinct, discreet thing here comes out of the interactions of quantum fields and gravitational fields, so yeah.

The problem is saying "everything is X" makes X useless as an adjective.

Usually, when you talk about this stuff, you look just a couple layers of reality. For example, if your lower level is water molecules and the upper level is observation, then "waves" "whirlpool" and so-forth are emergent objects/characteristics and water is a primitive object/characteristics - never mind that water molecules emerge from still lower level processes.

Re:Complexity Explained by walleeee on Saturday February 06, 2021 @11:24AM (#26047550)
Philip McShane wrote something similar

"...a thing is defined by... systematizations of coincidental aggregates of the properties of lower things [and] the emergence of the systematic from the non-systematic"

Re:Complexity Explained by hntrader on Saturday February 06, 2021 @06:16PM (#26051058)
So-called emergent properties are just categorical abstractions that we've created in our mind to cognitively handle the complexity of the macroscopic world around us. These are evolved mental heuristics.

There's nothing beyond fundamental physics that's required, in principle, to explain these emergent properties, so in this sense I'm a philosophical reductionist. Emergence is just an illusion created by our brain's inability to deal with the true nature of fundamental reality.

Re:Complexity Explained by kaba0 on Sunday February 07, 2021 @06:21AM (#26054235)
There is no point in talking about the temperature of a single atom/molecule, but it is an important statistical property of a group of molecules with unique “features”.

The sum is more capable than each of it’s constituents. You could argue that a hyper-intelligent entity can explain everything due to temperature by the simple movements of atoms but that is not true, since with temperature, we can reason about a system we know only one property about, while the said entity would have to know every detail about every atom. In other words, we created a new thing that could not have existed alone. (Perhaps it is not the best example, but there are countless others :) )

Re:Complexity Explained by hntrader on Sunday February 07, 2021 @01:26PM (#26056896)
These emergent properties that you mention (temperature, intelligence) can in principle be described by the individual components (particles) along with the fundamental laws of physics that govern their interactions. The emergent property that we observe is just a cognitive abstraction designed to strip away the complexity and describe the aggregate behaviour of the group of individual components.

Our mind was designed to work this way. The most advantageous way to perceive a rock is as a single object with properties pertaining to utility (hardness, potential weapon, etc). This takes the least cognitive load and is the most beneficial way to perceive the world from a fitness perspective.

There's nothing epiphenomenal above and beyond the individual components (and the laws governing their interactions) except in our minds. In that specific sense, emergent properties are an invention.

Re:Complexity Explained by kaba0 on Wednesday February 10, 2021 @06:40PM (#26096361)
I wrote an explicit example for a case where your analysis doesn’t seem to be correct, but you didn’t resolve the issue — temperature makes new observations possible that were not possible before and it is not tied to the human reasoning (also, it is only but one example, perhaps not even the best).
Re:Complexity Explained by hntrader on Friday February 12, 2021 @07:48PM (#26120417)
I don't know if the assertion you made is true, ie that an omniscient entity can't explain everything there is to know about temperature by looking at the simple movement of atoms. What's the basis for this? I know you followed that up with a rationale, but I didn't really follow. Just because this abstraction (temperature) allows us to come to conclusions and inferences about state and state changes doesn't mean that there's anything real about the abstraction aside from the cognitive structure in our brains that helps us to process the world around us effectively.
Re:Complexity Explained by tenaciousDaniel on Saturday February 06, 2021 @09:48AM (#26046829)
I've always found videos like these to be the most direct (and beautiful) examples of this principle:

https://www.youtube.com/watch?v=CCiIUjPF060

Re:Complexity Explained by crdrost on Saturday February 06, 2021 @10:40AM (#26047226)
Complexity is not just about these larger features, although they are certainly manifestations of complexity. So like a mechanical watch is complex, but it is complex in a very different way than weight gain or weight loss is.

Nevertheless yes, this is the basic idea. Systems theory speaks about how you have substances flowing between different buffers or containers, as well as feedback loops that look at the buffers and adjust new flows based on those buffers. Or at least that is one of the most universal models. A nice general set of theorems about this are the fixed point theorems, which say that in a very large set of circumstances such systems find themselves in a “fixed point,” a set of buffer quantities and flows that is self-sustaining and usually healing from small perturbation. This is why when you stop dieting you gain back the weight; the same causes lead to the same effects.

The complexity of systems theory in particular comes from a few different properties worth thinking about:

(a) not being able to predict the whole from the parts and thus not knowing how to change the system to facilitate the overall behavior change [in other words “if dieting doesn't work, what does?]

(b) metastability transitions where there is enough random variation to allow for spontaneous reorganization between multiple fixed points [in other words if I get skinny in the Netherlands and fat in the US, then maybe American pandemic-me is skinny but Dutch pandemic-me is fat—as a corollary there is no such thing as “best practices” really, the same “causes” do not produce the same effects: what is the difference with the above?]

(c) when you do manage to create change, it is typically by thinking wishfully about what the system should do and then driving it to produce that “at whatever cost” and initially some “bottlenecks” emerge which appear to be resistant to the desired change, which you want to think is bad, but what actually starts to happen is that everything else about the system re-architects to reinforce that “bad” thing and that makes it okay. [In other words the journey from fat to skinny may seem to be limited at first by my love of food and joyous hedonistic eating... if that's the main bottleneck then unlike a diet’s plan to make me deny myself, my healthy relationship with food will actually feature more of that, indeed the reason that I was fat was that I did not love food enough and with delectatio morosa consumed whole boxes of cookies not for my truest enjoyment of them but because the pleasure of even a few cookies was always denied to me. If you read Marie Kondo's book you may be struck that her diagnosis of mess is that you have too much stuff and her prescription for having too much stuff is perversely not to love your stuff less and be more stoic but to actually love your stuff more. Ecclesiastes seems to come to a similar conclusion.]

Yeah, I think those are the most outrageous parts of dealing with systems which makes me astonished by their “complexity.” I often find that if I ask “why can't we do that,” I get some response “because of such-and-so” and then I surprise my interlocutor by saying “but what if I accept the such-and-so?” and, we eventually arrive at a whole different self-consistent system.

One example of this in a tech context since I feel I have overmilked the health context: “What if we don't have merge conflicts?” “psh, yeah right, you're never gonna get rid of merge conflicts.” “ok but pretend I am dumb, tell me why?” “because people modify the same code in different ways and you have a conflict!” “so if I could make them take turns then there would be no conflict?” “well you can't make us all take turns on the codebase! That would mean only one person is allowed to work at any given time!” “Ah I see your point, but what if it's more like a Google Doc where everyone sees other peoples' changes in realtime, that sequences the edits so that they never have merge conflicts.” “but then we couldn't do code reviews properly!” “why does that matter?” “because when I am setting out to rewrite the auth logic, I put the thing into a half-finished state! The code review protects those failing states from getting to prod.” “Ok, so is there a way to develop without failing states?” “Well, kind of. Like I can write `if (false)` and then write breaking code. But if our codebase were littered with those I would never be sure what I needed to re-enable.” “So there's no way to define your own version of true and false for this thing you're working on?” “I mean, I guess a boolean variable. But that won't work either.” “why not?” “if you have 10 of those then you have 1,024 different states that the system can be in, it becomes a nightmare.” “and you can't remove them when a developer is done?” “not without proper code review! That's what I am saying!!” “okay but what if you then have both mini review and proper review, mini reviews just check to make sure that everything is behind a feature toggle, very quick approval-at-a-glance of work in progress: then bigger reviews happen when you instate the new code path and delete the old one. We could detect those mass deletions, yeah?” “I mean, yeah, but, I mean, this is just not how it's done. Nobody develops code like this.” “Well, can we try it as an experiment for a month and see if we like never having merge failures more than we hate doing things a new way?”