Large language models are having their Stable Diffusion moment

Re:Large language models are having their Stable Diffusion m... by Taek on Saturday March 11, 2023 @09:48PM (#35115920)

OpenAssistant has already collected 100,000 human feedback examples, estimated 5,000+ hours of human work via crowd sourced volunteers.

Enough programmers want this badly enough that its going to happen. Inference at 8 GB and fine tuning at 24 GB, just like stable diffusion, on a 13B model.

[ Parent | on HN ]

Re:Large language models are having their Stable Diffusion m... by boredhedgehog on Sunday March 12, 2023 @03:52AM (#35117816)

From what I gather, tuning a language model is like jury duty: The more eager someone is to volunteer, the less useful his input is going to be.

[ Parent | on HN ]

Re:Large language models are having their Stable Diffusion m... by Taek on Sunday March 12, 2023 @03:57AM (#35117842)

I don't think the quality of the OpenAssistant data represents that idea at all.

[ Parent | on HN ]

Re:Large language models are having their Stable Diffusion m... by sebzim4500 on Sunday March 12, 2023 @09:57AM (#35120077)

This sounds incredibly hard to believe, unless your concern is that advertisers will poison the well.

[ Parent | on HN ]

Re:Large language models are having their Stable Diffusion m... by vintermann on Monday March 13, 2023 @10:02AM (#35135845)

Is it that hard to believe? If you look at Stable Diffusion, I'd say a lot, maybe the majority of the volunteer effort was focused on anime girls and "realistic" pictures of anime girls (which amounts to young faces on adult bodies).

[ Parent | on HN ]