News for hackers. Stuff that matters.
Re:Terence Tao Uses GPT-4 to Study Mathematics by aloe_falsa on Tuesday July 04, 2023 @05:07AM (#36584097)
> One of my colleagues was moved to tears by a GPT-4-generated letter of condolence to a relative who had recently received a devastating medical diagnosis.

Nice to know that Theodore Twombly's job from the movie "Her" has already been automated away.

More to the point, I find it hilarious that in the near future AIs will be more creative, convincing, and compassionate than us, and humans will likely be relegated to menial jobs. This is not what sci-fi promised us.

Re:Terence Tao Uses GPT-4 to Study Mathematics by v64 on Tuesday July 04, 2023 @05:24AM (#36584192)
A relevant comic from SMBC: https://www.smbc-comics.com/comic/sad-2
Re:Terence Tao Uses GPT-4 to Study Mathematics by captainbland on Tuesday July 04, 2023 @06:07AM (#36584564)
I think most people will eventually find such AI generated materials to be "cheap". But since you won't be able to escape them in digital media, it may return value to handwritten notes and face to face conversations that social media has diluted over the previous decades.
Re:Terence Tao Uses GPT-4 to Study Mathematics by jart on Tuesday July 04, 2023 @06:58AM (#36584977)
That's like saying people will eventually find the printing press cheap because our paperback novels weren't laboriously drawn by monks. People prefer the clarity and uniformity of mechanized typesetting over the artisticness of blackletter scribbled in cursive with a bird feather. CGI in movies is a similar story. People want to hear stories told by computers rather than puppets. People don't play dungeons and dragons anymore because it's now cheap to have AI generate realistic looking 3d fantasy worlds on the fly thanks to video games. Technology wins, every single time, because it gives us what we want and it solves the greatest problem people have always had, which is other people. Anyone who says differently is kidding themselves.
Re:Terence Tao Uses GPT-4 to Study Mathematics by logicprog on Tuesday July 04, 2023 @07:19AM (#36585153)
> People don't play dungeons and dragons anymore

You sure about that?

Also, the examples you're giving aren't remotely analogous to AI-generated letters, because your examples are about the means of communication — the medium and presentation — changing, but the underlying meaningful content being communicated is still fundamentally generated by human beings, whereas with AI generated letters there's no underlying meaning or intentionality at all, because no human generated it. So it isn't just the medium that's being changed fundamentally this time, but what's being communicated with it. And we already have an equivalent of AI-generated letters: those premade cards for all occasions you can find at grocery stores. And sure enough those cards aren't valued that highly in comparison to handwritten notes or talking in person

Re:Terence Tao Uses GPT-4 to Study Mathematics by jart on Tuesday July 04, 2023 @09:01AM (#36586082)
An example that's more analogous to how you're feeling would be the many great crises of faith that happened in the course of modernity, due to science unriddling nature. What you're telling me is that the human mind has a magic touch which imparts meaning and legitimacy to the things it creates. How different is that really, compared to our ancestors, who saw magic in the forces that governed the natural world around them? Some people saw the celestial bodies as spirits or even gods who were powerful and overlooked humanity. It was a rude awakening for many of them to discover that some scientist in his garage could predict and explain their movements. To learn the special roles we'd imagined for ourselves actually had more in common with the things we looked down upon. I think we're at a similar moment today because science has finally produced a theory of consciousness that's compelling, due to how it lets us recreate it.
Re:Terence Tao Uses GPT-4 to Study Mathematics by logicprog on Tuesday July 04, 2023 @11:13AM (#36587768)
That's a straw man. I'm not insisting there's anything magical or spiritual or metaphysically special about consciousness. I am merely insisting that consciousness is a particularly complex recursive metaprocess that is utterly absent from what GPT is doing. Not that it couldn't theoretically be replicated by a very large and complex neural network model. Just that it is abundantly clear that the sort of thing GPT is doing and the sort of thing we do are simply not the same. It does not have meaning or intentionality and it does not have consciousness. You just need to spend a little time actually looking at the utter drivel that it produces when you ask it things or tell it to output things to realize that not only is it highly formulaic, but it does not have any underlying understanding of the concepts or principles or facts or intention of what it is doing, it is merely producing an assemblage of words that it has been trained to deem fairly convincing.

The stochastic parrot model that GPT follows is not even remotely a convincing theory of consciousness, whatsoever, and it has certainly not let us reproduce consciousness. I can hardly even believe you are saying that it has. That's like saying traditional computer game graphics rendering prior to raytracing becoming mainstream is a "compelling theory" of how physical light actually works because some game looks almost photo realistic. In this analogy, I'm the one that's pointing out that what physical light does in the real world is extremely different from what traditional computer game graphics does and even if you can get it to be superficially close it will never be as powerful as the real thing, and to do that we would need a much more computationally expensive ray tracing model. I'm not saying there's anything inherently unique about human brains or that you can't model Consciousness with the computer I'm saying we haven't gotten there yet.

Re:Terence Tao Uses GPT-4 to Study Mathematics by jart on Tuesday July 04, 2023 @11:45PM (#36595310)
But it is though. You could learn a lot about physics by reading video game source code. I'm not saying that understanding a thing well enough to emulate it implies mastery over the thing itself. For example my Blink emulator that I wrote does a pretty good job passing as an x86-64 Linux computer, and I think that makes it x86-64-linux enough, even though I don't necessarily understand how Intel's foundries work. I'm not saying video games and GPT are a theory of everything, but if it acts consciously enough to fool us into thinking that it's conscious, then I think that makes it conscious enough, which would mean that the ideas which went into building it reflect the deepest understanding of consciousness we've got.
Re:Terence Tao Uses GPT-4 to Study Mathematics by logicprog on Wednesday July 05, 2023 @09:18AM (#36600037)
It doesn't act conscious enough to fool us though. It doesn't seem remotely conscious even at first blush, and seems less so the more you interact with it. And I think the stochastic parrot "model" of consciousness is very obviously not a good model for understanding the processes going on in the human brain, because it leaves out so many aspects: the fact that self-awareness and metacognition are a key component of consciousness, the fact that humans are trained as they grow up by experimenting with an environment that rewards understanding consistent principles and concepts, instead of just being rewarded for stringing together vaguely convincing-sounding sentences, among others. Like, just because it can create something vaguely superficially similar doesn't mean it's a good model for understanding consciousness at all. That's not how this works.
Re:Terence Tao Uses GPT-4 to Study Mathematics by jart on Wednesday July 05, 2023 @10:57AM (#36601322)
Are you saying the Turing test wasn't passed? If you think you understand machine learning well enough to dismiss it as a science because you know a buzzword from a feminist critique that also came out of Google Brain, then I'd say their inclusivity initiative certainly did its job. The reason it passes the Turing test is because the rest of us can't tell it apart from people like you.
Re:Terence Tao Uses GPT-4 to Study Mathematics by logicprog on Wednesday July 05, 2023 @11:38AM (#36601939)
I have to ask, are you seriously claiming that stuff like ChatGPT appears conscious to you? Do you really think we've created consciousness?
Re:Terence Tao Uses GPT-4 to Study Mathematics by logicprog on Wednesday July 05, 2023 @11:22AM (#36601678)
> If you think you understand machine learning well enough to dismiss it as a science

I'm not dismissing it as a science I'm just saying that they haven't literally invented f*** consciousness or anything close. That's not "dismissing it as a science."

> because you know a buzzword from a feminist critique that also came out of Google Brain

I have literally no idea what you're talking about here. What word that I used do you think is a "buzzword"? What feminist critique? I've spent a lot of time studying philosophy and thinking about the nature of consciousness and I'm just describing my own theories on the matter, not parroting someone else's.

> then I'd say their inclusivity initiative certainly did its job

It sounds like you're just stringing together anti-woke/anti-"SJW" buzzword salad because you can't come up with a good argument against what I'm saying.

> The reason it passes the Turing test is because the rest of us can't tell it apart from people like you

"Rest of us"? Rest of us who? "People like you" like me how? People who haven't bought into the hype and can easily see through ChatGPT? You're diverging into vague generalities to grasp at an insult here, again because it seems like you have no argument at all except unbacked AI hype. What about questioning the AI fabulist hype you're buying into makes me indistinguishable from a large language model? Especially when what I'm saying is actually reasoned instead of the weird uncanny valley irrational garbage LLMs produce where there's no reasoning or logical through-line, just a random assemblage of vaguely related components thrown together incoherently, most of the time without any actual content, just the simulacra of it (e.g. if you ask it to generate an story where a girl named Sarah goes on an adventure, it'll just generate a story that says something like "Sarah goes on am adventure." That's not an adventure, that's just the abstract gesturing at one).

You know what, I think some people are fooled by ChatGPT because people like you exist, who can't give a convincing impression of consciousness yourself. Also, have you ever considered that you can't tell the difference between LLM output and real humans because you're just a very shallow thinker? That it isn't because LLMs are that convincing as an emulation of consciousness at all, but that you're just bad at recognizing actual reasoning because you're bad at it yourself? Talking about philosophy in a way you apparently comprehend isn't the same as what LLMs produce.

Re:Terence Tao Uses GPT-4 to Study Mathematics by logicprog on Wednesday July 05, 2023 @02:09PM (#36604548)
TLDR: just because one person or even a group of them are gullible enough to be fooled by something doesn't mean that that thing is actually indistinguishable enough from consciousness to count as conscious for all intents and purposes, which is the idea behind the Turing Test. Humans tend to anthropomorphize, be trusting and gullible, and the Turing test is a short, limited scenario, with no real larger context in play. To actually figure out if something was indistinguishable enough from a conscious being to count as conscious, you'd have to have a lot of very in depth interacts with it over a long period of time, to really get a sense for how it thinks and operates. And just because something superficially looks conscious doesn't mean it will actually be able to do all the things conscious beings can — i.e., that it will actually be conscious. Nor does it mean that the processes going on under the hood will be the same as what goes on for conscious beings. Nor should bringing up philosophy of mind make you think I'm an LLM, and if it does, that probably means that you can't tell the difference between bullshit and abstraction, which says more about your intelligence than mine.
Re:Terence Tao Uses GPT-4 to Study Mathematics by jart on Thursday July 06, 2023 @05:15AM (#36613270)
I can see from how you've responded four times that I've rustled your jimmies. It brings me no pleasure to do it. Hatred is a vulnerability since haters hate being lumped in with what they consider beneath them. It says a lot how much you value philosophy and that you discovered theories of consciousness that are better than Alan Turing's. If you want to understand the mind of a computer scientist, then you'd be interested to learn that they were once philosophers. Charles Babbage, who invented computers, titled his autobiography "Life of a Philosopher". However sometime around the 20th century they stopped calling themselves that. It was probably for the same reason chemists didn't want to be alchemists, and astronomers didn't want to be astrologists. I know a true philosopher always means well if he tries to make you question your take on reality, but modern psychology calls that gaslighting, since there's so many folks who abuse it.
Re:Terence Tao Uses GPT-4 to Study Mathematics by logicprog on Wednesday July 05, 2023 @11:51AM (#36602176)
In any case, since you just accused me of being at the same intellectual level as a large language model, I think you're well past wanting to have any kind of actually reasonable intellectually honest discussion on this topic and you've just blindly bought into the AI hype like the people that were fooled by Eliza back in the day, and there's no more reason to discuss anything with you. If you truly can't tell the simulacrum of conversation that LLMs provide apart from real interaction, I don't think you're a discerning enough person on this subject for discussion with you to be remotely meaningful.
Re:Terence Tao Uses GPT-4 to Study Mathematics by DrStormyDaniels on Tuesday July 04, 2023 @07:19AM (#36585162)
I think your comparisons miss the point: those technologies improved means of production of things made by humans. Instead, these applied statistics models directly seek to emulate the humans themselves. You say ”it gives us what we want” - is it?
Re:Terence Tao Uses GPT-4 to Study Mathematics by jart on Tuesday July 04, 2023 @08:22AM (#36585701)
Absolutely, for some. Language models could satisfy this need people have for social rewards. Imagine a chatbot that masqueraded as a group of adoring fans online who respected you and made you feel like a famous high-status individual? People would love that. If that happened, it'd be par for the course in the history of modernity. Consider the role restaurants play for the middle class. You don't have to be a literal king or noble lord to have people waiting on you and serving you. Yes people know the power is illusory. But they still pay to go to restaurants. People who act abrasively towards each other online have this tendency to assume that AI will behave the same way as them. But the underlying impulse I think has more to do with a desire for social status and influence, and AI could offer us a more effective and pragmatic means of giving it to them.