News for hackers. Stuff that matters.
Re:Excuse me but why are you eating so many frogs by Infernal on Thursday September 08, 2022 @12:09PM (#32767637)
As someone who has not "used GPT-3" what does it mean to say that you used it to make a summary? Just dump the full text of the article into a tool and request a summary output?

I have only seen GPT-3 used when it takes a prompt and then generates more related text, I didn't realize you could run that process in reverse.

Re:Excuse me but why are you eating so many frogs by Tenobrus on Thursday September 08, 2022 @12:25PM (#32767864)
The main interesting thing about GPT-3 is that prompt engineering turns it into an incredibly general tool. This summary was likely generated with a prompt something like:

Here's an article about x: <text of sample article>

A quick summary of the article, focusing on the main relevant points and keeping critical detail: <sample summary>

as an example, then duplicating that with the real article and text.

That's the "few shot learning" from the original paper. It could also be that it's good enough at summarizing specifically that you don't need an example, just the right framing prompt around the article text. Either way, that kind of prompt engineering is how you get "text completion" to perform basically any text processing task, generate code or play tic tac toe, so on

Re:Excuse me but why are you eating so many frogs by redhedgehog12 on Thursday September 08, 2022 @12:29PM (#32767912)
Not OP but I've used GPT-3 quite extensively and can imagine that's exactly what they did.

You can give it anything - or nothing - and ask for any kind of output.

The relevance and accuracy of what it gives you can vary lots. You can give it examples of the types of things you want back etc. You don't necessarily have to give it examples either, just ask it a question. It normally performs better on semi-complex tasks when you give it examples though.

Re:Excuse me but why are you eating so many frogs by dwohnitmok on Thursday September 08, 2022 @01:59PM (#32769289)
> I have only seen GPT-3 used when it takes a prompt and then generates more related text

This is a fully general technique. Any repeatable problem can be rephrased as a prompt + related technique via the following structure:

  Problem: <Example of Problem>

  Solution: <Example of Solution>

  <...maybe include one or two more examples>

  Problem: <Real Problem>

  Solution: <Ask GPT-3 for the solution>