News for hackers. Stuff that matters.

A comment on GPT-Neo – Building a GPT-3-sized model, open source and free. Parent comment

Re:GPT-Neo – Building a GPT-3-sized model, open source and free by hundchenkatze on Monday January 18, 2021 @03:43PM (#25826405)
Apart from that, hopefully the people building training sets use gltr or something similar to prevent training on generated text.

http://gltr.io/

[ Parent | on HN ]
Re:GPT-Neo – Building a GPT-3-sized model, open source and free by a1369209993 on Tuesday January 19, 2021 @01:48AM (#25830705)
Well, hopefully, someone will come up with a language model that picks words based on GLTR purpleness. Automated data collection deserves automated data.
[ Parent | on HN ]