News for hackers. Stuff that matters.
Re:Inductive or Deductive? Rethinking the Fundamental Reason... by gaganyaan on Monday September 02, 2024 @02:49PM (#41427859)
See my other comment too, but I agree. Rocks and lightning aren't conscious of anything, because they have no state that represents anything. Amoeba are conscious of some things, because they have state that represents a tiny slice of the world. Cats are conscious of much more, then LLMs and humans in turn.

It's not about animate vs inanimate, it's about models that represent something.

There's also some confusion because we have limited language here. A person can be "unconscious", but that doesn't mean they've lost their world model. It's just currently not executing.

Re:Inductive or Deductive? Rethinking the Fundamental Reason... by quantadev on Monday September 02, 2024 @03:44PM (#41428235)
Unconscious brains appear to be functioning normally as far as all of science can tell, except for one big difference: Brain Wave frequencies. Only the lower frequencies exist. Higher frequencies are scientifically proven to be required for consciousness. You can call that a meaningless correlation that happens to be totally inconsequential, but most neuroscientists strongly disagree with that.

EDIT: I mean neuroscientists know brain frequency is more than an accidental correlation with consciousness.

Re:Inductive or Deductive? Rethinking the Fundamental Reason... by gaganyaan on Monday September 02, 2024 @08:31PM (#41430003)
TBH, I don't really know what you're driving at with brain waves. They're not magic. I think you're trying to use "consciousness" to mean "high level brain activity", as opposed to something like the lizard brain? To which I say that you're making a distinction that isn't there. Your lizard brain is perfectly conscious of many things. It's just conscious of fewer things than your prefrontal cortex.

I mention "unconscious" only to help disambiguate an overloaded word. It's used for both "this model includes something in its representation" as well as "this model is currently executing".

Re:Inductive or Deductive? Rethinking the Fundamental Reason... by quantadev on Monday September 02, 2024 @09:11PM (#41430227)
I just don't think Qualia emerges from computations. I think it's a wave phenomena, because all the neuroscience evidence indicates that. There's nothing magical about EM waves. Waves are a well understood physics with well understood mathematics governing their behaviors.

People often just hear the phrase "brain waves" and immediately think of "woo woo spirituality" because all the spiritual crack pots are constantly talking about waves without even having a physics background.

Re:Inductive or Deductive? Rethinking the Fundamental Reason... by godelski on Tuesday September 03, 2024 @06:33AM (#41433382)
What you keep describing is computation. Or as best as I can tell because "brain waves" and "em waves" aren't that detailed of descriptions. Luckily computation is just as vague
Re:Inductive or Deductive? Rethinking the Fundamental Reason... by quantadev on Tuesday September 03, 2024 @12:32PM (#41436565)
I'm actually leaning towards a postulate that Schrodinger Waves are the core of the dynamic we call qualia (which is quite different from EM field itself), but at some point it has to interact with EMF in order to be able to effect motor neurons and cause actions.
Re:Inductive or Deductive? Rethinking the Fundamental Reason... by godelski on Wednesday September 04, 2024 @01:24AM (#41442170)
As a physicist, I've NEVER heard anyone say "Schrodinger Waves." Surely you mean "probability waves".

How about picking up a physics textbook? The status quo for Quantum is Griffith's Introduction to Quantum Mechanics. Might I also suggest his E&M book (again, a standard). If you're half as passionate as you portray, I'd also pick up Jackson. That's the standard graduate level E&M book (but a warning on this: to get through Chapter 1 you're going to need to be intimately familiar with PDEs and Green's Function. To get further, I sure hope you like Bessel functions).

Take your passion and use it to drive you to prove. Don't just conjecture and don't try to derive things from first principles. You will get it wrong because you won't actually be working from first principles. Again, don't ignore humanity's greatest invention. It's so much easier to catch up than reinvent the wheel.

Also, you should become familiar with Penrose. I'll leave it to you to figure out why.

Re:Inductive or Deductive? Rethinking the Fundamental Reason... by quantadev on Wednesday September 04, 2024 @02:03PM (#41448645)
Stuart Hameroff's work in microtubules I think might be the one doing the closest work do discovering Quantum Effects in consciousness, and I tweet with him a lot on twitter. He hasn't yet been convinced that brains are entangled with PAST copies of themselves which is a core precept of my theory. The other person getting close to discovering the truth of my theory is Leroy Cronin, who has come up with `Assembly Theory` which is very reminiscent of my theory, but lacks the aspect of entangled negentropic structures being able to self-resonate. And also Michael Levin's work showing how he can get worms to have two heads even with the same exact DNA of the single headed ones (just as one example), is something I can derive directly from my theory. Since you're obsessed with my credentials: BS in Mech. Eng., been studying QM for decades, a software developer by profession since 1991, but thanks for the book recommendations, and most especially the genuine politeness.
Re:Inductive or Deductive? Rethinking the Fundamental Reason... by godelski on Wednesday September 04, 2024 @03:36PM (#41449779)
I'm not obsessed with your credentials, I can just tell you haven't read much of the literature.
Re:Inductive or Deductive? Rethinking the Fundamental Reason... by quantadev on Wednesday September 04, 2024 @04:44PM (#41450585)
ad hominem for the win! Nice one.
Re:Inductive or Deductive? Rethinking the Fundamental Reason... by mistermann on Friday September 06, 2024 @04:48PM (#41469603)
Rhetoric FTW also.

Have you done substantial reading?

Re:Inductive or Deductive? Rethinking the Fundamental Reason... by godelski on Monday September 02, 2024 @06:22PM (#41429269)

  > because they have no state that represents anything.
Are you sure about that? Both have lots of representation to them. Rocks have their atomic structures and you can easily view this as code. You can also view lightning as a representative of the intersection of cloud and ground states.

The point I'm making is that representation is not enough. Storage (or memory) is not enough even recall is not enough. If it is, then any mechanical process is. Because you can build computation machines out of nearly anything. You can build memory out of almost anything. And the hello world python program I wrote has both!

You can argue scale, but we see animals with much smaller scale than these ML models perform unambiguous reasoning tasks and critical thinking. You can then argue architecture and data, but then that's not just scale.

The problem with all these people making claims is that they don't consider base assumptions and they don't follow the consequences of the model (your mental model of what is consciousness) is and must mean! So many people argue that they are working from "first principles" but I don't see anyone writing down their fucking axioms.

Of course you should try to prove what you want, but not at the cost of not being wrong. Doing so will prevent you from achieving what you want. I'm just so tired of people shooting themselves in the foot and calling it medicine. We need to stop with all the bullshit because I actually want to build AGI

Re:Inductive or Deductive? Rethinking the Fundamental Reason... by og_kalu on Monday September 02, 2024 @08:32PM (#41430008)
>Are you sure about that? Both have lots of representation to them. Rocks have their atomic structures and you can easily view this as code. You can also view lightning as a representative of the intersection of cloud and ground states.

Sure then following OP's model outlined here https://news.ycombinator.com/item?id=41427796, rocks are simply conscious of the passage of time. Perhaps it can be said that is the one thing every matter in the universe is conscious of.

>The point I'm making is that representation is not enough. Storage (or memory) is not enough even recall is not enough.

You don't know what is or isn't enough.

And by the way, what 99% of people think of a concept they can scarcely define, test for or prove doesn't mean shit. We are regularly wrong about concepts with much stronger standings.

Humans don't have any special insight to consciousness. We can't even make decisions without unknowingly altering our preferences and fabricating reasons in the process. What makes the conscious mind tick was clearly lost along the way.

>We need to stop with all the bullshit because I actually want to build AGI

No, you want to build the idea of AGI that exists in your mind. Clearly not Artificial General Intelligence seeing as what exists today checks all those boxes.

Re:Inductive or Deductive? Rethinking the Fundamental Reason... by gaganyaan on Monday September 02, 2024 @08:45PM (#41430099)
AGI exists now. We need better terminology.

You want something more, and that's fine because I do too. Our state-of-the-art models are baby AGI, because they can accomplish a wide variety of tasks without being specifically trained for it. They can do limited reasoning on new tasks. That's intelligence that's both artificial and general. But it's just the start.

There's a few axes that need to be captured. Breadth of knowledge, ability to reason, and ability to update the model based on new information. LLMs are great at 1, possible superhuman. For 2, they're 1/10 on a scale of 0 to human. For 3, fine tuning and prompt stuffing get the job done for now, but they're a far cry from human ability.

And yes, you can build computation machines out of nearly anything. If you simulate a human brain with sticks and stones, what does it matter the substrate?

Re:Inductive or Deductive? Rethinking the Fundamental Reason... by godelski on Monday September 02, 2024 @11:05PM (#41430855)

  > AGI exists now
AGI exists if we redefine AGI to mean what we have now. But otherwise, no, it doesn't. What we have today does not meet the criteria that have been standard for the last half century[0]. I know people have a hard time keeping up, but no, the Turing Test is not the accepted threshold and hasn't really ever been. It was a starting point, and I should mention we beat it since at least 1967 (<20 years since Turings proposal). Nor is Chess, which we succeeded at in 1997.

What I hate about these conversations is that people learn the basics but there's been a lot of advancements since the 50's. We've learned a lot since the 90's too! Yes, the metrics keep changing, but they are not in response to the current state of the art in a specific effort to make the systems not AGI[1]. But rather the criteria keeps changing because we keep learning. It would be ludicrous if it didn't! Because WE STILL HAVE NOT CONCRETELY DEFINED CONSCIOUSNESS, REASONING, THINKING, and many other similar terms. The criteria are generally guides created by best guesses. But until we have formal definitions, expect it to change (and when we do have formal definitions, be sure as hell to understand their assumptions!).

But I can confidently tell you that LLMs do not exhibit generalization in the way we've been using it for decades. This is easy to demonstrate but if you're a true believer then there's no convincing. And in that case, just don't bother arguing either.

I really do encourage people to take their passion and use it to drive gaining a deep expertise on these subjects. You're passionate right? I hope that passion is not about "being right" or "having answers" and is actually about "understanding." And if you can't differentiate that, I suggest starting at the beginning, since these topics are covered there.

[0] Sure, you can find examples of people stating criteria, but I can find you samples of idiots, even among scientists.

[1] There are some bad faith people who do this but they're terrible people too. You may freely disregard their opinions.