343242dfsdf
We may probably not survive the very first wave of really advanced AI technology or we could get out in very bad shape, and then we could have AGI right there, or worst.
But we could already be quite shaken. Interesting time are coming.
Most people don't know exactly how the dataset is "fed" to the training pipeline, but with the current state-of-the-art you can say the feeding is like when a human reads aloud a text, not re-reading ever, not a single word.
And then you're asked about what words you've read most often, their order and how many times they appeared in the text. Then, with those numbers you just gave, some probabilities are calculated and anotated, and there you get a "token".
There are obvious improvements plausible to be applied to that basic processing, and most are being applied already, but there's plenty of room for evern further improvement apparently.
Claude says that the previous text could be described like "a simplified metaphor of model training", so you're warned about simplicity.
It would be a good experiment to interact with the unfiltered, not-yet-RHLFed interfaces provided to the initial trainers (nigerian folks/gals?).
Or maybe the - lightly filtered - interfaces used privately in demos for CEOs.
The way the current interface for most models works can result in this kind of output, the quality of the output - not even in the latests models - doesn't necessarily reflects the fidelity of the world model inside the LLM nor the level of insight it can have about a given topic ("what is the etymology of the word cat").
The current usual approach is "one shot", you've got one shot at the prompt, then return your output, no seconds thoughts allowed, no recursion at all. I think this could be a trade-off to get the cheapest most feasible good answer, mostly because the models get to output reasonably good answers most of the time. But then you get a percentage of hallucinations and made up stuff.
That kind of output could be - in a lab - fully absent actually. Did you you notice that the prompt interfaces never gives and empty or half-empty answer? "I don't know", "I don't know for sure", "I kinda know, but it's probably a bit shaky answer", or "I could answer this, but I'd need to google some additional data before", etc.
In a lab, with recursion enabled, the models could get the true answers probably most of the time, including the fabulous "I don't know".
but I think it wouldn't make much economic sense to make public a prompt interface like that.
I think it could also have a really heavy impact in the public opinion if they get to see a model that never makes a mistake, because it can answer "I don't know", so there you have another reason to do not make prompts that way.
You can do "reasoning" about a topic, the LLM can produce a very similar output to what you could, how do you name the output of the LLM?
Birds can fly, they do by a natural process. A plane also can fly, we do not "see" any difference between both things when we look at them flying in the air, far from the ground.
This is mostly it about LLM "doing reasoning" or not. Semantics. The output is same.
You could just name it otherwise, but it would be still the same output.
The potential of a sufficiently intelligent agent, probably something very close to a really good AGI, albeit still not an ASI, could be measured in billions of billions of mostly inmediate return of investment. LLMs are already well into the definition of hard AI, there are already strong signs it could be somehow "soft AGI".
If by chance, you're the first to reach ASI, all the bets are down, you just won everything on the table.
Hence, you have this technology, LLM, then most of the experts in the field (in the world blabla), say "if you throw more data into it, it becames more intelligent", then you "just" assemble an AI team, and start training bigger, better LLMs, ASAP, AFAP.
More or less this is the reasoning behind the investments, sans accounting the typical pyramidal schemes of investments in hyped new stuff.
There is intelligence. The LLM current state-of-the-art technology produces output analog to natural intelligences.
This things are already intelligent.
Saying that LLMs aren't producing "intelligence" is like saying planes actually don't fly because they are not flapping their wings like birds.
If you run fast enough, you'll end flying at some point.
Maybe "intelligence" is just enough statistics and pattern prediction, till the point you just say "this thing is intelligent".
Hence, some potential achievements, maybe AGI, ASI, are actually atenable, because the predicted path to achieve them is some more cash dumped into a giant hardware backend, from where you, eventually,
would get to retrieve enough intelligent entities that will be capable of designing a better AI, or will be able to solve any social-organizational/technologic/economic bottleneck found in the way, thus enabling a simpler and/or easier achievement of the gotten objective, being AGI, ASI, whatever.
Allowing mankind to get there going through a better path.
if it's energy, a new source, a revamping of previously known source (micro-nuclear reactors everywhere, ubiquitous solar power, freeing the current fossil generated electrical networks thus allowing a much greater world provision of energy)
if it's economic growth without humans, because of a shrinking population, it could be technology automation (such as prompt based helpers everywhere, heck, the prompt technology could be just an offspring of the actual original - still secret - idea of a powerful LLM, to enable the next step in the AI evolution path).
Maybe the AI bubble is not a bubble, but just the beginning.
Remember that the current models, if proven as the definitive path to AGI/ASI will be with us for centuries to come, probably enhanced, they would be effectively inmortal.
The first thing you'd want to achieve is to make work an AI agent capable of writing software, good software, then you could just ask it to make other types of agents, QA soft engineers, SRE engineers, DBA engineers, what ever you need.
Devin for starters is mentioned capable of training and tunning models. So, there you go.
The "you" is because "you" are a lot of smaller stuff instances of things running along in your brain.
Probably it's common to develop this multiple "yous" and kept them happily running (may be with therapy some get to "shutdown" or "suspend" some "evil" "you" they have running and messing everything).
But some people don't need several instances of themselves, and they just run one "you" thing. Hence, no internal monologue.
Unless, some kind of ad-hoc architecture permits the AI to grow up, which could be a project or two already, behind the information firewall of the research teams. Not going here to "caution, AGI explosion possible", but more a grounded "some could guess our trick and stole the market before us".
For the singularity thing, too many people worried about, and most probably we will hit singularity a lot of time before we actually acknowledge that we have done. Not AGI stuff again, remember that extremely advanced (AI) technology is more than enough to radically change society, not AGI required.
There are hypothesis that global warming is intrinsecally related to planetary dynamics, such as a giant volcano exploding under the ocean, and similar events.
But what would happen if you said aloud that nothing can prevent further global warming, and it is actually expected to increase to levels that will make soon some great areas in the planet uninhabitable.
Probably the best - for some - is to keep the CO2 discourse at high pitch.
Also, I'm not hypothesizing about a future super-intelligent AI, maybe we're far close to a good enough opensource LLM (which could be capable of running and then spawing itself inside a big infrastructure, think "some sysadmin AWS credentials + critical servers taken over, GPUs added to its underlying configuration"), who with some ill auto-prompt could end spreading mayhem just by some unmanaged automation gone wrong.
But to make it feasible to be presented to authorities which have a serious lack of understanding of the current level of the AI technology, the best path could be to show the risks using the most probable scenarios - even if they aren't the worst - say, what if an "runaway" AI has taken over some important human network to make it its home, could be the Maerks global IT network, a big bank network, some transportation infrastructure, you name it.
Then you need to step in and clean that network, working against a seemingly impossible to erradicate adversary, which at any blink of an eye could just jump using whatever connectivity means available to the hacked network.
Add this: the AI has taken over the network, it is using its resources, but it keeps it working as intended, then it threats to just blow it out before jump, if you make any attempts to erradicate its presence from the infrastructure.
I.E. singularity has just arrived to the planet
What would you do?
Language is the source code of human intelligence and/or consciusness.
If the current artificial intelligent systems are capable or not of true intelligence and/or consciusness (alike biologically understood consciusness, AKA homo sapiens-sapiens), isn't really a technological matter anymore, but a geopolitical one.
No one can accept now it could potentially exists technology as capable as a tool as as a weapon. And anybody could build one out of code scraps
An intelligence so powerful that can square the circle, in a war.
That's why these systems "can't be" intelligent, nor conscius. Or whatever trick they're playing, undistinguisable from biological intelligence / consciusness.
So these things "can't exist", nor anyone should be building them out of nation-states and big corporations.