News for hackers. Stuff that matters.
Re:AI knows things no one told it by kgeist on Friday May 12, 2023 @06:32PM (#35923358)
If you invent/introduce made up concepts and rules on the spot ("let shmerple be ..."), which can't be possibly found in its training data, then, from my experience, when queried, LLMs are able to correctly reason most of the time... So it's not just Markov chains regurgitating sentences verbatim from their dataset.

Even if this kind of intelligence is just statistics, does it really matter? If it quacks like a duck, it's a duck. Maybe our own brains are nothing more than overrated statistical machines?

The only issue I see with the hype is when people attempt to anthromorphize it.

Re:AI knows things no one told it by milchek on Friday May 12, 2023 @06:40PM (#35923444)
Some great points, and this is where these discussion can get into the freewill vs determinism arena.

If you’re more of a determinist, then human brains are basically like organic LLMs and we’re just unique models trained on our own life’s datasets - with other traits/data like preferences and biases also being inherited via genetics, of course.

Re:AI knows things no one told it by throwaway22032 on Friday May 12, 2023 @06:38PM (#35923420)
Yeah, it's bizarre.

Are we not simply employing statistics when we deduce that yes, if we release our grip, the smartphone will fall to the floor?

You wouldn't have to ever see a phone drop in order to know that, and neither would you have to study or know of the terminology of gravity.

It comes from the statistical knowledge that all things fall when not blocked.

Re:AI knows things no one told it by 1000thVisitor on Friday May 12, 2023 @06:48PM (#35923511)
The key here is abstraction, not statistics. You have seen other items fall and are able to abstract this and then apply it to the phone.
Re:AI knows things no one told it by sharemywin on Friday May 12, 2023 @06:55PM (#35923574)
1. Rule of probability: The concept of statistics is being used to predict outcomes based on previous observations or experiences, such as the likelihood of an object falling when released.

2. Rule of inherent knowledge: Some understanding or knowledge, like objects falling when not supported, can be known without explicit study or exposure to the specific terminology (e.g., gravity).

3. Rule of generalization: Observations or experiences with one type of object (e.g., a smartphone) can be generalized to other objects or situations, as long as they share similar characteristics (e.g., not being supported).

4. Rule of causality: There is an implied cause-and-effect relationship between an action (releasing the grip) and an outcome (the smartphone falling to the floor).

5. Rule of experiential learning: Knowledge can be gained through direct experiences, even if the specific terms or scientific concepts are not known.

Re:AI knows things no one told it by thom on Friday May 12, 2023 @08:12PM (#35924088)
Why would LLMs not learn abstractions when given millions of of concrete examples?
Re:AI knows things no one told it by jamilton on Saturday May 13, 2023 @10:11PM (#35934725)
Why would it necessarily learn abstractions?

I believe GPT-3 doesn't have the abstraction for arithmetic.

Re:AI knows things no one told it by thom on Sunday May 14, 2023 @11:48AM (#35938853)
Neither did my children for several years.
Re:AI knows things no one told it by chpatrick on Friday May 12, 2023 @06:46PM (#35923490)
Is it wrong to anthromorphize if it quacks like a human?
Re:AI knows things no one told it by og_kalu on Friday May 12, 2023 @06:50PM (#35923535)
Not only is it not wrong, it's actually in our best interests to do so past a certain level of agency, embodiment and unsupervised tool control.

If the machine acts like it has emotions, runs forever(this kind of agency is already possible to implement though expensive) and can use tools, then treat it like it doesn't have emotions at your own peril. When the machine can "hit you back" (not necessarily physically of course), you'll learn manners pretty quickly. You can see glimpses of this with bing.

Re:AI knows things no one told it by hammyhavoc on Friday May 12, 2023 @06:57PM (#35923589)
> You can see glimpses of this with bing.

Oh please. The human gives the verbose output meaning by projecting onto it. You're clearly letting your emotions run wild. It's a fucking LLM.

Re:AI knows things no one told it by og_kalu on Friday May 12, 2023 @07:05PM (#35923631)
Real word actions and consequences give the words meaning. If you're rude to Bing, the conversation will end. You can keep typing but it won't respond.

Searching the web and ending conversations are the only two actions Bing can currently do so what i'm saying is less applicable for now. But humanity is gearing up to give more and more control of more and more tools to increasingly powerful LLMs. Hell Bing is scheduled a bump in tools in the coming weeks.

Hate to break it to you but "it's not real [insert property]" is not a shield. Not when you allow the machines to interact with the real world.

If your words to [insert LLM] guide responses that perform actions detrimental to you then those actions are no less real or detrimental because you've deluded yourself into thinking "it's not real understanding" is an intelligent argument.

Re:AI knows things no one told it by hammyhavoc on Friday May 12, 2023 @07:15PM (#35923708)
So? This is a guardrail added by a Microsoft employee, mate. After their earlier dabblings in AI outputting bigotry and general toxicity, someone in their wisdom saw the sense to try and prevent going down a negative conversation path, hence all the edge lords on Reddit offering prompts to "jailbreak" an LLM and bypass the guardrails, which then get patched by a human being not long after.

You're projecting so much meaning onto something that is functioning as designed by throwing a sentiment var into the calculation, just like you can measure "sentiment" with social media analysis tools to get a feel for which way the wind is blowing or which of the millions of tweets at your brand might be worth prioritizing.

Do you really believe you've thus offended an LLM? That is delusional.

Re:AI knows things no one told it by felix318 on Friday May 12, 2023 @07:49PM (#35923938)
I’m not in the least worried about the supposed dangers of AI; I don’t see it causing major unemployment, nuclear armageddon, or anything particularly scary. However, I think the real danger with those chatbots is how people are becoming emotionally involved with them. This is clearly by design and it’s working extremely well with so many people.
Re:AI knows things no one told it by hammyhavoc on Friday May 12, 2023 @07:52PM (#35923959)
Yes, completely agreed. There's a lot of being kidded that it's more than what it actually is because the hype is overblown. Statements are being made and repeated that simply have no basis in reality right now, nor in the future. Even this assumption that we are close to having AGI, I can only laugh.
Re:AI knows things no one told it by georgeg23 on Saturday May 13, 2023 @11:18AM (#35929198)
But none of its behaviour is even close to by design. The emergence of reasoning is completely unexpected for a word prediction model.
Re:AI knows things no one told it by og_kalu on Friday May 12, 2023 @09:11PM (#35924441)
It's a guardrail that Bing controls, which is the whole point.

It doesn't matter what i believe or not. or what you believe or not. What matters are actions and consequences. "It's not really offended" doesn't change the outcome or make it less material(in this case - the end of the conversation). You're focusing on things that don't matter in the slightest.

It doesn't need to be "really offended", whatever that means to you. It just needs to be able to model being offended well enough to take actions that resemble an offended person. If you don't understand that then i don't know what else to tell you.

Re:AI knows things no one told it by hammyhavoc on Friday May 12, 2023 @09:24PM (#35924522)
It's a guardrail that Microsoft controls, which the LLM is bound by.

If a car has a hood and headlights reminiscent of a face and tells you to "buckle up, buttercup" when you don't do your belt, does that mean it's genuinely caring for you?

Re:AI knows things no one told it by og_kalu on Friday May 12, 2023 @09:35PM (#35924590)
Microsoft arranged the guardrail. Bing decides when it should be implemented, much like an employee.

>If a car has a hood and headlights reminiscent of a face and tells you to "buckle up, buttercup" when you don't do your belt, does that mean it's genuinely caring for you?

Why do you keep going on pointless tangents?. Whether you think it genuinely cares or not is irrelevant. This isn't a hard concept to understand.

Re:AI knows things no one told it by hammyhavoc on Friday May 12, 2023 @09:42PM (#35924631)
Source? Because every source I'm finding tells me pretty much words to this extent, which doesn't support what you're saying whatsoever with the LLM choosing to do anything:

"RAIL (Reliable AI Markup Language) is a language-agnostic, human-readable format for specifying structure, type information, validators, and corrective actions for LLM outputs. RAIL, an XML flavor, allows users to define the expected structure and types of LLM outputs, the quality criteria for valid output, and the corrective actions to take if the output is invalid."

Why do you keep projecting your own humanity onto the LLM?

Re:AI knows things no one told it by og_kalu on Friday May 12, 2023 @09:58PM (#35924716)
Source for what ? Do you have any idea of what you're talking about ? Hold on, How do you think Language models work ? What do you think the plain English Instructions are for ?
Re:AI knows things no one told it by hammyhavoc on Friday May 12, 2023 @10:07PM (#35924766)
A source for how guardrails function as what you state isn't what's documented. You said that the LLM chooses when to use them.

The LLM sits behind the toolkit which sits behind the guardrails. Are you sure you understand how they work?

The guardrails monitor your input, the output of the LLM, and modify the output to suit, including terminating the chat.

Re:AI knows things no one told it by og_kalu on Friday May 12, 2023 @10:37PM (#35924939)
It should be in line with the likes of this - https://arxiv.org/abs/2302.04761 or https://twitter.com/minosvasilias/status/1627076214639976449

I didn't say guardrail to mean anything particularly elaborate. The pre-prompt for Bing has instructions to avoid adversarial arguments.

Re:AI knows things no one told it by version_five on Friday May 12, 2023 @06:55PM (#35923575)
> Maybe our own brains are nothing more than overrated statistical machines?

This is a tired assertion, easily disproved for current llms (read some of Lecun's stuff) and if some variation is going to be claimed, it needs to be an affirmative defence. "Maybe x is true" is a meaningless statement.

Re:AI knows things no one told it by bheadmaster on Sunday May 14, 2023 @12:25PM (#35939113)
> "Maybe x is true" is a meaningless statement.

How so? If we don't know what "real intelligence" consists of, how can we know that LLMs can't have "real intelligence"?

Re:AI knows things no one told it by lewhoo on Friday May 12, 2023 @07:22PM (#35923760)
does it really matter? If it quacks like a duck, it's a duck

I think it absolutely matters if by only quacking we also want to know is it possibly wanting, feeling, experiencing, having an ego etc.

You say LLMs are able to reason, but https://youtu.be/QO2BvVq_fWU?t=663 here is a proponent of the more simplistic explanation of how they work. On one hand I saw pretty convincing arguments for it having the ability to reason, on the other hand how do we even conclude anything if we can't really know what's in the training data.

Re:AI knows things no one told it by version_five on Friday May 12, 2023 @08:44PM (#35924291)
Also want to add:

  ELIZA: How do you do.  Please tell me your problem.
  YOU:   I'm worried about shmerple
  ELIZA: Do you believe it is normal to be worried about shmerple ?
The fact that it can insert your made up word into patterns has no significance in itself.
Re:AI knows things no one told it by unsupp0rted on Saturday May 13, 2023 @10:25AM (#35928735)
ChatGPT answers the way a human might:

> I'm sorry to hear that you're worried about someone named "shmerple." Can you please provide me with more information about who shmerple is and why you're worried about them?

Re:AI knows things no one told it by c22 on Monday May 15, 2023 @08:31PM (#35956410)
Sorry, but this doesn't sound like any human I've ever spoken to.
Re:AI knows things no one told it by unsupp0rted on Monday May 15, 2023 @08:42PM (#35956469)
How would a human, say the receptionist at your dentist's office who doesn't know you at all, respond to something like this?

First question would be: is Shmerple a person or a concept, and assume it's a person, since most people don't start conversations about worrying about concepts.

Therefore: who is Shmerple and why are you worried about them?

Re:AI knows things no one told it by c22 on Monday May 15, 2023 @10:24PM (#35957142)
Sure, your sentence sounded human to me. It's not the content I'm looking at, but the delivery.