News for hackers. Stuff that matters.
Re:After 118 days, GPT Unicorn has produced a unicorn by itsoktocry on Thursday August 10, 2023 @08:54AM (#37075547)
>This comment section is a super fascinating case study on the inherent flaws in human cognition. Especially when it comes to seeing patterns in random noise. The fact that some people believe that the model really has to have changed in the past few days is amazing

You need only to look at the discourse around the Tesla FSD superusers to see this: they report a glitch at an intersection one day, then believe the next day it was "fixed" by the AI.

Re:After 118 days, GPT Unicorn has produced a unicorn by olabyne on Thursday August 10, 2023 @09:00AM (#37075603)
Thats even worse for autonomous cars, there is so such data and noise there is no way to reproduce the issue, it's complete chaos. Whereas with a LLM if we control the seed we can 100% reproduce the same result
Re:After 118 days, GPT Unicorn has produced a unicorn by noduerme on Thursday August 10, 2023 @09:10AM (#37075702)
>> if we control the seed we can 100% reproduce the same result

No, that's the problem. You can't. You should be able to, but you can't. If you could, they wouldn't be scary. But we have Temperature Zero, different results. Because no one gave enough of a shit when coding them, and no one gives enough of a shit to try to fix the issue.

This is what in any other industry would be called gross negligence.

Re:After 118 days, GPT Unicorn has produced a unicorn by jquery on Thursday August 10, 2023 @09:35AM (#37075978)
* * *
Re:After 118 days, GPT Unicorn has produced a unicorn by noduerme on Saturday August 12, 2023 @05:47AM (#37098575)
Interesting article. I can see how it makes sense for OpenAI or someone with a LLM to take advantage of any entropy that presented itself, as a shortcut to non-repetitive answers. I'm not sure if you're saying that these LLMs take on new characteristics as they get more randomized? Or just that it would be hard to get your hands on a fresh one to test the determinism of?
Re:After 118 days, GPT Unicorn has produced a unicorn by olabyne on Friday August 11, 2023 @06:47AM (#37087196)
That's a OpenAi problem, not a LLM problem
Re:After 118 days, GPT Unicorn has produced a unicorn by sigmoid10 on Thursday August 10, 2023 @09:15AM (#37075759)
>Whereas with a LLM if we control the seed we can 100% reproduce the same result

No, you can't. For the latest GPT models and the way they are run, this doesn't work anymore, making the experiment completely illogical. Some of the reasons are explained here pretty well: https://152334h.github.io/blog/non-determinism-in-gpt-4/

Re:After 118 days, GPT Unicorn has produced a unicorn by olabyne on Friday August 11, 2023 @06:51AM (#37087217)
This sounds more like a bug than a feature.
Re:After 118 days, GPT Unicorn has produced a unicorn by Karawebnetwork on Thursday August 10, 2023 @10:27AM (#37076586)
I noticed similar a behavior in Stable Diffusion forums where people believe that the model they downloaded and are running offline is getting better at understanding their prompts.
Re:After 118 days, GPT Unicorn has produced a unicorn by kozikow on Thursday August 10, 2023 @11:00AM (#37077017)
Stable diffusion most likely don't do it, but even static model that as an input takes embedding of all your historic prompts + current prompt would get progressively give you better inputs as you use it.
Re:After 118 days, GPT Unicorn has produced a unicorn by joshspankit on Thursday August 10, 2023 @08:08PM (#37083410)
Yes, but currently that would be a conscious choice (and extra intentional effort)
Re:After 118 days, GPT Unicorn has produced a unicorn by mcbuilder on Thursday August 10, 2023 @10:45AM (#37076816)
Go into /r/chatgpt and /r/bing and it's a bit scary how many people anthropomorphize the models.
Re:After 118 days, GPT Unicorn has produced a unicorn by cosmojg on Thursday August 10, 2023 @11:14AM (#37077205)
Honest question, why do you find it scary?

I agree that some people take it too far, but most seem to be using metaphor to abstract away the underlying complexities and facilitate conversation. I did the same thing back in college, anthropomorphizing cells and even molecules when I was learning about microbiology and biophysics (e.g., kinesins[1] are a family of postal workers who work hard to deliver packages to their clients in a timely manner, and they spend their free time going for strolls and practicing on their favorite tightropes). I now do it in my day-to-day work at an AI/ML shop to communicate not just what the entire pipeline is doing, but what individuals layers or encoders are doing, or even what variables in an equation are doing. I find that my colleagues and I are better able to understand and remember concepts and ideas when they're communicated as part of an anthropomorphic story, but we scarcely forget that the things we're dealing with aren't human.

But maybe I'm missing the point, and you're really worried about that first, smaller group of people who have really swallowed the Kool aid. To that, I can say that I don't think their behavior exceeds the baseline craziness/weirdness that I've come to expect from humanity. I'm sure there are far more people who believe in astrology than who believe that we've achieved true humanlike artificial general intelligence, for example.

[1] https://youtu.be/y-uuk4Pr2i8

Re:After 118 days, GPT Unicorn has produced a unicorn by weebull on Thursday August 10, 2023 @01:26PM (#37079014)
> Honest question, why do you find it scary?

What I find scary is how much trust people put into the answers.

Today, I saw someone saying "Look! ChatGPT can design my home solar electrical circuit". That kind of thing will lead to new Darwin awards being given out.

Thing is, if people will trust it to do that right, when will politicians write policy papers with it? Let's face it, they already are. Other people won't want to read those long papers, so they'll ask it to summarise it for them. At that point you have LLMs writing laws and reviewing laws. It's all fine as long as nobody enforces them.

Right?

Re:After 118 days, GPT Unicorn has produced a unicorn by renewiltord on Thursday August 10, 2023 @11:05AM (#37077098)
Interesting that modern discourse is to use "scary" and "dangerous" and such words so much more. I wonder if it is related to the present rise in neuroticism and trigger warnings etc.

It's not particularly "scary" to me that people do that. I remember Boomer and Scooby Doo bots that people anthropomorphized and those were warbots from barely 10 y ago.

I suppose, in today's parlance, "it's scary how much people use fear-oriented language for normal things".

Re:After 118 days, GPT Unicorn has produced a unicorn by xtracto on Thursday August 10, 2023 @11:17AM (#37077246)
Great comment. I take it, the use of "scary" is more of a tool to provoke a stronger reaction or animosity to the comment reader, more than actually the writer feeling "scared" after seeing people anthropomorphising AI.

It seems to be the current trend in communication nowadays: A race to induce the strongest reaction possible.

Why should someone be scared of that? We have anthropomorphised chairs, brooms and whatnot since the Walt Disney times and I am sure before in classic literature (I am not that literate to know for certain).

I prefer to be 'amazed' or 'excited' about what is happening: It means that AI is getting to a point where people feel it more 'relatable'. We are getting to that point in our technology development. The number of things we will be able to do with a technology with which we can interact that seamlesly is great.

Re:After 118 days, GPT Unicorn has produced a unicorn by vineyardmike on Thursday August 10, 2023 @01:56PM (#37079490)
> Interesting that modern discourse is to use "scary" and "dangerous" and such words so much more. I wonder if it is related to the present rise in neuroticism and trigger warnings etc.

I doubt it’s trigger warnings because they usually don’t “warn scary things”.

Also is there any data to back up that scary and fear is used more today than in the past? That seems unlikely.

Re:After 118 days, GPT Unicorn has produced a unicorn by joshspankit on Thursday August 10, 2023 @08:06PM (#37083397)
> and those were warbots from barely 10 y ago.

Some people even anthropomorphized Eliza. To your point: if you cherry pick enough and survey enough people; “some people” will do just about anything.