Re:GPT-3: Language Models Are Few-Shot Learners
by runawaybottle on Friday May 29, 2020 @09:48AM
(#23349919)
If we get to large scale text generation like that, we are all going to have to become even better skimmers due to how the meta language will evolve.
So take your standard press release. We know about two thirds of it is just fluff. In other words, we are accepting the mass of fluff as one word in our language, it translates to ‘ignore’.
Our own language will change in that case.
Re:GPT-3: Language Models Are Few-Shot Learners
by KhoomeiK on Friday May 29, 2020 @03:03PM
(#23354161)
What might some valid sources of data for this be? Perhaps comparisons of Simple English Wikipedia to the standard English Wikipedia? We'd need a side-by-side comparison of condensed information and a fluffed up piece.
Essentially, one should be able to use these models to "interpolate" the writing around the raw meaning/content. Typing assistance (think Grammarly) already allows you to refine finished writing to be more in line with what some language model expects, but imagine if it actually generated most of the text for you, based on small bites and chunks you throw at it.