News for hackers. Stuff that matters.

A comment on Google Update Tanks Traffic. Parent comment

Re:Google Update Tanks Traffic by hinkley on Thursday August 13, 2020 @02:53PM (#24146858)
Given how often I get top results that are clearly machine-generated content, I anticipate a lot of broken overfitting will happen in the near term.

If you train NLP on text generated by NLP, you're gonna have a bad time.

[ Parent | on HN ]
Re:Google Update Tanks Traffic by colejohnson66 on Thursday August 13, 2020 @02:59PM (#24146931)
Now I’m curious: what would happen if one repeatedly trained GPT-3 on text generated by a “previous generation” GPT-3? (Similar time successive JPEG saves)
[ Parent | on HN ]
Re:Google Update Tanks Traffic by AnimalMuppet on Thursday August 13, 2020 @03:02PM (#24146972)
I'm pretty sure it would drift further and further from something a human would recognize as intelligible.
[ Parent | on HN ]
Re:Google Update Tanks Traffic by datameta on Thursday August 13, 2020 @03:12PM (#24147108)
It would be a kind of DeepDream for NLP
[ Parent | on HN ]