Open AI gets GPT-3 to work by hiring an army of humans to fix GPT’s bad answers

Re:Open AI gets GPT-3 to work by hiring an army of humans to... by gojomo on Monday March 28, 2022 @02:43PM (#30834025)

Agreed! But, it's important not to confuse what's possible via 'human-in-the-loop' 'active-learning' with what's possible from an algorithm on a fixed training corpus.

Sometimes GPT-like models are portrayed as the latter – a highly automated, reproducible process – while this article makes a pretty strong case that the responses from OpenAI's public-facing interface get rapidly improved by a staff of dozens of contractors.

It's not surprising that a staff of 40 humans, given a few days time to consider & compose, can prepare human-quality answers to arbitrary questions!

[ Parent | on HN ]

Re:Open AI gets GPT-3 to work by hiring an army of humans to... by cyanydeez on Monday March 28, 2022 @08:13PM (#30837137)

I think, ultimately, what matters is how the labeling and corrective actions falloff over time.

But reasonable people will notice that information is streaming In faster than any single person can code

[ Parent | on HN ]

Re:Open AI gets GPT-3 to work by hiring an army of humans to... by ImPostingOnHN on Monday March 28, 2022 @10:43PM (#30838150)

In this example, it seems they fell off immediately, because the responses were only coded in response to questions asked in the way the author pre-published, and did not appear when the same question was asked in a slightly different way, which the GPT-3 authors did not have the opportunity to prepare for well ahead of time

[ Parent | on HN ]