Using GPT-3 to generate user interfaces

Re:Using GPT-3 to generate user interfaces by CJefferson on Thursday July 16, 2020 @05:12AM (#23857160)

This is a really cool demo, and congrats to the creator for making something really cool.

However, while these systems based on GPT-3, and similar techniques, can produce some amazing outputs given the right inputs, you don't have to poke them very hard before they start falling apart.

At the end of the day, this isn't really any more "clever" than a very, very advanced and long markov chain, there isn't any intelligence.

[ Parent | on HN ]

Re:Using GPT-3 to generate user interfaces by rbinv on Thursday July 16, 2020 @05:33AM (#23857262)

> At the end of the day, this isn't really any more "clever" than a very, very advanced and long markov chain, there isn't any intelligence.

https://en.wikipedia.org/wiki/AI_effect - at least sort of

I get what you're saying, but is this really as fragile as you claim? I've been rather impressed by (GPT) input handling.

[ Parent | on HN ]

Re:Using GPT-3 to generate user interfaces by CJefferson on Thursday July 16, 2020 @05:36AM (#23857278)

I would never have thought this type of thing was clever. I don't want to pull expertise but I've been an AI research for 20 years, thinking this stuff isn't clever isn't new for me :)

If anything, this is "less clever" than older techniques like tree-search, as it is very easy to confuse, and will start just producing nonsense.

[ Parent | on HN ]

Re:Using GPT-3 to generate user interfaces by YeGoblynQueenne on Thursday July 16, 2020 @06:50AM (#23857626)

That's true, but who said that the goal is intelligence? This is clearly a demo from a startup that sells this kind of service [1]. All that's needed is something that can be made to work under certain business-dictated constraints. Nobody really needs these things to be actually smart.

Or, seen another way, it just has to be smarter than most peoples' web frameworks, or perhaps their IDEs, which is not a very high bar.

_________________

[1] Going by Sharif Shameem's Twitter profile (or bio, whatsitcalled):

founder at https://debuild.co – a faster way to develop web apps // @ycombinator alum // prev built @VectordashGPU // relentlessly optimistic

[ Parent | on HN ]

Re:Using GPT-3 to generate user interfaces by polyanos on Thursday July 16, 2020 @11:16AM (#23859841)

I can see GPT-3 being used in a tool/add-on ala Intellisense or Tabnine, but as something to create "a way for anyone to ship a functional web app just by describing what it should do in natural language" (quoted from his website) I'm positive that we have to wait for at least a GPT version that doesn't get confused after ~200-300 words.

I guess you could create some kind of UI prototyping app, but better options for that already exist, which don't require you to write everything out.

[ Parent | on HN ]

Re:Using GPT-3 to generate user interfaces by dumb1224 on Thursday July 16, 2020 @06:27AM (#23857539)

I often wonder how much (percentage-wise) the model is 'encoding' certain knowledge, the equivalent being how much does a person know about web development etc. A lot of research are using transfer learning in this fashion, which assumes most of or at least a large chunk of trained weights are relevant to a different task they are attempting (in contrast to the model was originally trained for). So if coding these UI requires very little language skill then you are really using a very small part of the model (or am I too naive)?

[ Parent | on HN ]