I asked GPT-3 to make a presentation for me

Re:I asked GPT-3 to make a presentation for me by jcims on Monday July 20, 2020 @05:27PM (#23902098)

In short, yes. I think of it as plinko with a hundred billion pegs...the output is extremely sensitive to the starting conditions (including things like whitespace).

Given we really don't know how it's all working, it's safe to say that prompt composition is an artform that one can develop a skill at.

I was on a discord server with some other folks and one of them had access to the GPT-3 api. We provided a prompt similar to the following:

    This person is a Canadian singer, songwriter, and actor.  Discovered at 13 years
    old by talent manager Scooter Braun after he had watched his YouTube cover song
    videos, they were signed to RBMG Records in 2008. With this person's debut EP My
    World, released in late 2009, they became the first artist to have seven songs from
    a debut record chart on the Billboard Hot 100.

    Q: What is this person's name?
    A:

At first pass it gave some weird answer. So we deleted the answer and tried again. The second time it wrote 'Justin Drew Bieber'.

That chunk of biographical info is from his Wikipedia page, but it's really kind of remarkable to me that it was able to really even understand the question, let alone mine its relationships and cough up the right answer.

[ Parent | on HN ]

Re:I asked GPT-3 to make a presentation for me by dmurray on Monday July 20, 2020 @07:18PM (#23902894)

That sounds well within the capabilities of IBM's Jeopardy bot, Watson. That was demoed 10 years ago and, while initially impressive, seemed to be mostly cheap tricks even then.

[ Parent | on HN ]

Re:I asked GPT-3 to make a presentation for me by zaarn on Tuesday July 21, 2020 @03:08AM (#23904902)

Well, the thing is that GPT3 isn't specifically trained to be a Jeopardy bot.

[ Parent | on HN ]

Re:I asked GPT-3 to make a presentation for me by abernard1 on Monday July 20, 2020 @09:25PM (#23903550)

I typed your text directly into Google, and it immediately gave a context box with the correct answer.

I even typed in: "person who sings EP MyWorld" and got the same answer. Given how much data there is about him (the infamous Twitter scaling problems), I don't think it's necessarily a good test. There's gonna be tons of relations in the corpus for him.

[ Parent | on HN ]

Re:I asked GPT-3 to make a presentation for me by jcims on Monday July 20, 2020 @10:12PM (#23903758)

Sure this capability can be engineered into a system to some degree.

For me the remarkable part is that it’s emergent behavior in large scale language models.

[ Parent | on HN ]

Re:I asked GPT-3 to make a presentation for me by nullc on Monday July 20, 2020 @06:17PM (#23902462)

> At first pass it gave some weird answer.

The default sampling parameters are really not that hot for cases where there is nearly a unique correct answer-- bad luck will force to to ask wrong.

From that prompt I (a human) don't know if I should expect something like "Albert Einstein" or the straight answer, so higher temperature sampling can risk kicking it down a silly path.

[ Parent | on HN ]

Re:I asked GPT-3 to make a presentation for me by schoen on Monday July 20, 2020 @07:32PM (#23902974)

I put the same prompt into the question-answering preset and it immediately answered

A: Justin Bieber.

So that suggests that the prompt and temperature (etc.) are relevant to getting the kind of behavior you want. But it didn't seem to have any trouble getting this right the first time with the appropriate preset.

[ Parent | on HN ]

Re:I asked GPT-3 to make a presentation for me by jcims on Monday July 20, 2020 @08:18PM (#23903224)

Does it still work if you fuzz some of the facts? Eg teenager instead of 13, skip Canadian, etc?

[ Parent | on HN ]

Re:I asked GPT-3 to make a presentation for me by schoen on Monday July 20, 2020 @08:26PM (#23903260)

> Q: This person is a singer, songwriter, and actor discovered as a teenager by talent manager Scooter Braun. Who is this person?

> A: Justin Bieber is a singer, songwriter, and actor discovered as a teenager by talent manager Scooter Braun.

> Q: What famous singer was discovered as a teenager by talent manager Scooter Braun?

> A: Justin Bieber was discovered as a teenager by talent manager Scooter Braun.

It's really good when in the factual question answering mode.

> Q: What famous singer was discovered as a teenager by talent manager Scooter Braun?

> A: Justin Bieber was discovered as a teenager by talent manager Scooter Braun.

> Q: What country is he from?

> A: He is from Canada.

> Q: Who's the prime minister of that country?

> A: Justin Trudeau is the prime minister of Canada.

> Q: Who was his father?

> A: Pierre Trudeau was his father.

> Q: Why was Pierre Trudeau famous?

> A: Pierre Trudeau was famous because he was the prime minister of Canada.

> Q: When did he take office?

> A: He took office in 1968.

> Q: What was the year before that?

> A: The year before that was 1967.

> Q: What was the summer of that year known as?

> A: The summer of that year was known as the "Summer of Love".

[ Parent | on HN ]

Re:I asked GPT-3 to make a presentation for me by jcims on Monday July 20, 2020 @09:04PM (#23903458)

Whoa! Thanks for checking that out! Seems like a new contender for jeopardy lol

[ Parent | on HN ]