News for hackers. Stuff that matters.

A comment on Books in .txt format for AI training purposes.

Re:Books in .txt format for AI training purposes by numpad0 on Sunday October 25, 2020 @01:26PM (#24888014)
I’ve tried some sci-fi nonsense on GPT-2 in the past and it returned flattened out phpBB replies, complete with usernames and headers. So whatever they are trained with must include web crawls.
[ Parent | on HN ]
Re:Books in .txt format for AI training purposes by minimaxir on Sunday October 25, 2020 @03:58PM (#24889397)
GPT-2 was trained on web links linked to from Reddit which would explain your output.

GPT-3 was trained on the Common Crawl + books.

[ Parent | on HN ]