News for hackers. Stuff that matters.
Re:AI doppelgänger experiment – Part 1: The training by monadINtop on Sunday May 19, 2024 @02:05PM (#40408624)
lol sometimes I wonder if the reason so many tech bros make so many grandiose statements about how AI has already trancended the bounds of human creativity is because they've never really had actual experience with art and literature and music growing up. They say things like this and then you go and look for an example of these incredible works of artificial art and it is the biggest pile of shit you have ever seen.

Just like how they think that these glorified typing assistants function identically to the human brain. I mean maybe they really do replicate the level of creativity and intelligence of the people who believe these things, but maybe the people with decades of research in linguistics and neuroscience are right to be skeptical.

Its kinda like when people talk about research mathematics like its all adding really big numbers together or calculating really tricky integrals.

Re:AI doppelgänger experiment – Part 1: The training by ninetyninenine on Sunday May 19, 2024 @02:12PM (#40408677)
Not yet but this is not too far off:

One day you're going to encounter something that really moves you.

And then you'll realize it was procedurally generated, by an AI.

We're only about 1 - 2 years into AI. Think about the pace of progress.

Re:AI doppelgänger experiment – Part 1: The training by astrange on Sunday May 19, 2024 @05:56PM (#40410050)
There's a long tradition of random art and if you like that, there's dril GPT and Magic card GPT that produced lots of good absurdity. Of course, there's a human curation pass after it to let it be called art.

https://x.com/drilbot_aww/status/1792077476338057292

Re:AI doppelgänger experiment – Part 1: The training by ninetyninenine on Sunday May 19, 2024 @06:48PM (#40410320)
We just started on this. Imagine what the next two decades will bring.

This long tradition of stuff you speak of has only been a couple years at most. Draw the trend line. Extrapolate the inevitable consequence.

Re:AI doppelgänger experiment – Part 1: The training by astrange on Sunday May 19, 2024 @07:52PM (#40410649)
A lot longer than that!

https://en.wikipedia.org/wiki/Generative_art

Could also count elephant paintings and such.

Re:AI doppelgänger experiment – Part 1: The training by spywaregorilla on Sunday May 19, 2024 @02:18PM (#40408727)
Your dignified belief in the supremacy of human ingenuity will be cold comfort to the young artists struggling to find employment
Re:AI doppelgänger experiment – Part 1: The training by monadINtop on Sunday May 19, 2024 @02:23PM (#40408760)
Yep, you're right. But idk why you phrased that like it's a rebuttal to my criticism. This is another failure of our economic system, for incentivising the owners of art production to churn out literal mindless slop to cut costs, instead of safe guarding artists and creators for the sake of their intrinsic value to society and humanity.

Since, of course, they must eternally seek to reproduce capital to the detriment of everything else.

Re:AI doppelgänger experiment – Part 1: The training by spywaregorilla on Sunday May 19, 2024 @03:25PM (#40409161)
Well your argument is admonishing tech bros as if they don't get it, but generally they do get it completely in this context. The goal here is not replacing great art. It's replacing art assets.

Comes off as naive and distracting to me.

Re:AI doppelgänger experiment – Part 1: The training by monadINtop on Sunday May 19, 2024 @04:56PM (#40409681)
The distinction is philosophical. Tech bros consider "art assests" or consumer oriented products as art. In their eyes its capibility as a tool for profit is a downstream effect.

My point was that since their entire purpose in life revolves around developing and refining technology for the reproduction of capital, it reveals their blindness to any deeper aspect of the human condition than what can be sold for a profit. When people post 3d versions of the Mona Lisa or a shitty remix of Monet's water lillies with breathless praise, it's because in their eyes the stylistic reproduction or reinterpetation of the literal shapes and colors on a flat screen is all there is to art, not merely because it demonstrates utility in replacing already exploited sectors of creative workers.

I don't think we disagree about any of this. I think that I'm just making a tangential point to the article in response to a dumb comment, while you are talking about the subject more directly. Otherwise I fail to see what you think is naive, if only because I've seen so many examples of this rot of understanding around the essence of artistic expression from the mouthpieces of silicone valley and our wider, increasingly corporatized, culture.

Re:AI doppelgänger experiment – Part 1: The training by spywaregorilla on Sunday May 19, 2024 @07:21PM (#40410505)
> My point was that since their entire purpose in life revolves around developing and refining technology for the reproduction of capital, it reveals their blindness to any deeper aspect of the human condition than what can be sold for a profit

And I think that's grossly missing the point. The vast majority of people making art are just trying to make something look aesthetically nice within some sort of provided communication framework. And that's perfectly fine.

Frankly I think elevating artists to the pedestal of the illuminating the human condition is very damaging to their actual interests

Re:AI doppelgänger experiment – Part 1: The training by monadINtop on Sunday May 19, 2024 @08:38PM (#40410916)
Is creating things of aesthetic quality not of value with respect to the human condition? Is not some subset of that aesthetic quality derivative of the intuition and intention of a human mind? Sure, if you want to build some tehchnology to make designing packaging for dog food more effecient go ahead, as long as it isn't the previous dog food packaging creators that are being made to absorb the economic cost of the new technology (which they are).

But I hope at last some subset of human art strives to do more than that, and I think it's a bad thing that the incentive to increase revenue at the expense of quality has now expanded past being a tool to improve efficiency of laborious tasks and is now instead cutting costs via cutting artistic value.

Re:AI doppelgänger experiment – Part 1: The training by astrange on Sunday May 19, 2024 @05:44PM (#40409985)
If you need intelligent things to act exactly like a human being I think you're going to look bad in the future where we have aliens or uplifted ravens and this looks racist/speciesist.

Being trapped in a computer with no environmental interaction is obviously a big difference though.

> but maybe the people with decades of research in linguistics and neuroscience are right to be skeptical.

Like other kinds of academics, many of those people are cranks so they're not necessarily right. For instance, some of them are Chomsky.

(But it's their job to be wrong most of the time so of course this is expected.)

Re:AI doppelgänger experiment – Part 1: The training by monadINtop on Sunday May 19, 2024 @06:59PM (#40410386)
No, you need intelligent things to be intelligent.

And it would probably be good to distinguish between "things that appear superficially intelligent" and "things that have genuine capacity for internal experience" while you're at it, since the popular perception on this forum seems to be to just declare that physicalism/materialism is obviously correct and explanatory and we can just brush the hard problem of conciousness under the rug. People are so eager to endow the statistical model that has been designed to produce responses that are statistically feasable in a given context (a very impressive feat of technology to be clear) as having internal experience.

Chomsky happens to be more right about LLMs than 90% of the popular discourse will ever be able to understand, which isn't that suprising considering the impact if this "crank's" earlier work.

Re:AI doppelgänger experiment – Part 1: The training by astrange on Sunday May 19, 2024 @08:28PM (#40410854)
Chomsky's critique of LLMs was somehow not even correct about his own theories (https://x.com/profraha/status/1634311282135318529). And of course has the usual problem of 1. claiming LLMs are random statistical models (they aren't, the sampler is) 2. claiming instead of generating correct text they only "seemingly" generate correct text and not explaining why this is any less impossible.

But people have built explicit grammar knowledge into LLMs (it's in llama.cpp) and nobody seems to need it to make English text.

Of course the main reason Chomsky is a crank is that he's completely convinced he's right about politics despite his unbroken record of endorsing every mass murderer in the world as long as they're anti-American.

Re:AI doppelgänger experiment – Part 1: The training by monadINtop on Sunday May 19, 2024 @08:41PM (#40410938)
Oh right ok like I guessed, you have a ideological problem with him and his entirely irrelevant activism offends you, and so discredit any of his actual technical analysis on the subject. Maybe you do have the same faculty of reasoning as a LLM.
Re:AI doppelgänger experiment – Part 1: The training by optimalsolver on Monday May 20, 2024 @05:48AM (#40413828)
I swear there's a personality type that simply can't resist injecting their politics into unrelated conversations.

It's truly fascinating.

Re:AI doppelgänger experiment – Part 1: The training by astrange on Monday May 20, 2024 @10:40PM (#40423468)
I don't think that the opinion "70s intellectuals' love of the genocidal Khmer Rouge is bad" is "my" politics. I think this is a commonly held opinion actually.
Re:AI doppelgänger experiment – Part 1: The training by monadINtop on Friday May 24, 2024 @10:08AM (#40466433)
https://www.jstor.org/stable/25006809

https://www.counterpunch.org/2021/09/10/noam-chomsky-and-the...

stop spreading lies that have been debunked for decades, not everyone share your inability to parse information from outside your ideological bubble

Re:AI doppelgänger experiment – Part 1: The training by int_19h on Monday May 20, 2024 @02:17AM (#40412814)
Materialism is rather obviously correct when it comes to consciousness just based on what we know brain damage does to humans.

But what does this have to do with problem of consciousness or internal experiences? There's no reason why the latter cannot be a material process.

As for the linguists... people forget these days, but before the AI winter, there were many experiments trying to build an AI by modeling the language. And what they learned from it is that when you have enough compute and just throw it at a neural net, you get better results (there was even a joke about AI progress being inversely proportional to the number of linguists working on it). Which, to put it bluntly, means that our understanding of language is still very lacking, and quite likely to be fundamentally wrong some respects. I don't think those people are in a position to judge at that point; not until they figure out language enough to program something that can talk as well as GPT-4 does.

Re:AI doppelgänger experiment – Part 1: The training by monadINtop on Monday May 20, 2024 @06:35PM (#40421295)
There is zero understanding of the cause of internal experience. We can't even strictly define what it is. My contention isn't that materialism doesn't appear to be a reasonable canditate for cognitive process, but that we still have no idea HOW any of that happens. We may never know.

People who claim that it is obvious that neural networks and LLMs replicate the functioning of a brain, any brain - let alone human, are just wrong. They are wrong to assume that it is obvious that just making bigger LLMs will somehow generate a being with the capacity of internal experience, whatever that may mean. They are wrong when they act like they have solved the problem of understanding cognition by just forgetting to mention the hard problem of conciousness. They are even wrong to simply assert that neurons and neural networks are "to do" with cognition. Hallucinogens and brain damage affect subjective experience, and both of those things are involved with the vascular system of the brain. Would I be right to say the vascular system produce cognition? Why doesn't anyone argue in favor of that view since it is not too far off from the same reasoning?

Obviously, it's reasonable to assume that neurons are somehow involved with subjective experience, most serious neuroscientists and other researchers would hold that same assumption. But you need to EXPLAIN how, preferably with evidence. It is the burden of the one claiming they have finally figured it all out to present a convincing theory, or at least conjecture the path to get there. Loudly and smugly asserting that your assumption is correcter than the other people who have spent decades working on the problem doesn't make the problem dissolve, but it is especially irritating when the incentive of the loudest people doing so is in the pockets of the shareholders they are indebted to.