Animals may be more or less undetermined but a bee will make honey and an ant will gather food regardless of any individual instance of bee or ant intelligence.
The problem with the above objection is that there is no account of "meaning" in what an AGI does. In other words, it's still a computer. To say that the entropy of the system will determine the entity's indeterminism is akin to arguments saying Schrodinger's cat is evidence for the possibility of human free will. It's a category error. Unless you want to argue that humans are also computers (which is the position of many strict materialists) then there is still a huge gap to account for in terms of meaning that can't be defined away satisfyingly. We all know what it's like to be an intelligence. At best, people say we can't know if an AGI also knows that because we can't inspect their "minds". This argument is justified by recourse to the principle of the multiple instantiability of intelligence. If we admit that non-carbon-based life forms could be intelligent (e.g., extraterrestrials) then we may admit that intelligence could be in silica as well. Without the ability to introspect other minds, we assume they are like ours and not simply "zombies". The above arguments (reducible to "Well, how do you KNOW anyone else has a mind?") are based in a kind of skeptical solipsism. The part about intelligence being demarcated by non-determinism and the way that argument fails is a side-step of the hard problem of consciousness.
You can "decide" you won't "build a nest", but you'll certainly look for refuge if it is raining, or it's very cold. In the end, the human behavior is actually fully deterministic.
I'm sure FAANG already know this because they have the datapoints from billions of humans beings doing exactly the same stuff everyday for decades now.
This is probably how LLM can extrapolate all the things they "know" from human generated text: their tokens reflect the human behavior determinism a its fullest expression
(hence at more data for training, much better/closer their behavior ressemble the human behavior/ideas)
In any case, I'm not saying individual humans make many reasoned out decisions. Quite the opposite. Human individuals adopt a cultural second nature bequeathed to them by their heritage to avoid the necessity of making decisions. The culture over time adopts certain default decisions that are advantageous to survival. These are inculcated into the individual via their cultural conditioning. A baby has no culture and very few instincts (hunger, pleasure, pain, disgust). If you think humans are operating at the lower levels of instinct then why do they pursue or avoid certain behaviors that change over time? One answer is that they are responding to acceptable norms of behavior. As those norms change, they adapt and adopt. They change with the times, as the saying goes. A tiger can be trained to behave a certain way using stimulus/reward training but it doesn't self-regulate according to new norms. One could argue that elephants do this, if properly conditioned with a large stake early in life. But you could also make the case that elephants (like dolphins) are, like humans, self-conscious to a degree. I don't know if this is true, but it is an interesting thought. A more cynical person might say the elephant is not choosing anything but has been trained just like the tiger to avoid pain.
LLMs, or let us say AGI based on probabilistic models, can mimic behavior represented in its data and is very impressive at these language games and, with the right feedback, can correct some of its more glaring productions but it must ever be a parasite on human cultural production for it to gain what you call "knowledge". As a thought experiment, suppose we could set an LLM running on autopilot and send it into space with a feedback loop where it could add its productions to its source corpora. Is there any point in the future where it is generating new and coherent output? Or does it degenerate into raving madness?
haha just living life as usual, whatever internal stuff is feeding my main loop.
I left the deep thoughts to threads like this one and/or people more qualified.
Look at the history, many "definitive" hypothesis have been refuted along the centuries, when thinking about these I can just wonder how many people have lived their entire life under false premises, just because they were 100% sure "their" philosophy was the "definitive truth".
The truth in real life is a more fluid concept, it constantly changes with entropy (the main culprit if you go all the way down the reasons for change), so I can't take my hypothesis of human determinism as a definitive truth, neither live my life under that premise.
I'd recommend to anyone also to not live theirs thinking they cannot change their own fate.
Thanks again for your words, felt very touched.
This thing goes way deep into AI theories, but probaly AGI and artificial beings self-consciusness are two different problems. I think when the second problem gets solved, the human cultural production would no longer be necessary to "create" new AI / AGIs.
Society had long argued that animals were not intelligent, and that instincts were deterministic.