News for hackers. Stuff that matters.
Re:Neural Network Diffusion by Tenobrus on Wednesday February 21, 2024 @08:09PM (#39461837)
it is very clear to me that humans do in fact have a recursive self-improvement ability, and i'm confused why you think otherwise
Re:Neural Network Diffusion by astrange on Wednesday February 21, 2024 @09:00PM (#39462213)
I think people can read books (self improvement) and have children (recursive), but neither of those are both.
Re:Neural Network Diffusion by lucubratory on Wednesday February 21, 2024 @09:26PM (#39462409)
Why do you think that the human population is more intelligent, knowledgeable, and achieves greater technological feats as time goes on? It's because of recursive self-improvement, we are raised and educated into being better in a quite general sense, which includes being better at raising and educating; nearly every generation this cycle repeats and has for all of human history, at least since we acquired language. We also build machines that help us to make better machines, and then we use those better machines to make even better machines, another example of recursive self-improvement.
Re:Neural Network Diffusion by webmaven on Saturday February 24, 2024 @10:09AM (#39492016)
You're pointing out that groups/institutions/cultures/civilizations are examples of recursively self-improving entities, but the original point was about a recursively self-improving individual intelligent entity.

Well, to the extent that a human-level intelligence is an individual, anyway. We ourselves are probably a mixture-of-experts in some sense.

Re:Neural Network Diffusion by lucubratory on Saturday February 24, 2024 @04:22PM (#39495241)
An individual human starts out a mewling baby and can end up a maxillofacial surgeon through at least partial examples of recursive self-improvement. Learn to walk, talk, read, write, structure, argue, essay, study, cite etc all the way through to the end, with what you previously learned allowing you to learn even more. There's a huge amount of outside help, but at least some of it is also self-improvement.

Also, for the purposes of talking about the phenomenon of recursive self-improvement, individual vs society isn't the end of analysis. Part of the reason AI recursive self-improvement is concerning is that people are worried about it happening on much faster than societal timescales, in ways that are not socially tractable like human societies are (e.g. if our society is "improving" in a way we don't like, we or other humans can intervene to prevent, alter, or mitigate it). It's also important to note that when we're talking about "recursive self-improvement" when it comes to AI, the "self" is not a single software artifact like Llama-70B. The "self" is AI in general, and the most common proposed mechanism is that an AI is better than us at designing and building AIs, and the resulting AI it makes us even better at designing and building AIs.

Re:Neural Network Diffusion by rralian on Wednesday February 21, 2024 @09:31PM (#39462452)
New generations build onto the scientific knowledge of previous generations. It may not be fast but that sounds like recursive improvement to me. It seems reasonable for AI to accelerate this process.
Re:Neural Network Diffusion by astrange on Wednesday February 21, 2024 @10:35PM (#39462911)
I think saying all of society is doing it is plausible, but not the same thing as a single human or AI doing it.

Though… still don't think it's true. Isn't "society is self improving" what they call Whig history?

Re:Neural Network Diffusion by killerstorm on Thursday February 22, 2024 @03:14AM (#39464519)
AI might have multiple instances within a single computing environment, so it's more like a population than a single individual.

I.e. "You can only use the memory which you currently use" would be a weird artificial constraint not relevant in practice.

Re:Neural Network Diffusion by spacecadet on Wednesday February 21, 2024 @09:18PM (#39462349)
A very small percentage maybe. I think I agree with the notion that most people bias toward thinking they are improving while actually self-sabotaging.