News for hackers. Stuff that matters.

A comment on Show HN: Tensorpedia – Using GPT-2 to synthesize Wikipedia articles.

Re:Show HN: Tensorpedia – Using GPT-2 to synthesize Wikipedi... by JonahSussman on Thursday January 13, 2022 @03:36PM (#29926480)
Hey HN! I've been lurking for a while now and I've finally created something that I feel is worth sharing.

I've called this project "Tensorpedia." At its core, Tensorpedia takes in a title and utilizes it as a prompt for GPT-2 to synthesize the introductory part of a Wikipedia article. The machine learning stuff is written using a wonderful library called aitextgen [0], using Wikipedia's "Vital Articles" as a data set [1]. The server is written in Node, and it uses Redis as an article cache. If you want to read my article about it (for some reason), you can check it out here [2].

I created this project to get more experience with server technologies. While I wouldn't say it's a complicated application, I learned quite a lot from it.

Additionally, as I was inspired by all of those this-x-doesn't-exist projects from a while back, this project is mostly for fun. As such, I don't know how much practical use it has, but I've generated some pretty hilarious articles from it.

[0] https://github.com/minimaxir/aitextgen

[1] https://en.wikipedia.org/wiki/Wikipedia:Vital_articles/Level...

[2] https://jonahsussman.net/posts/2022-01-this-wiki-dne/

[ Parent | on HN ]
Re:Show HN: Tensorpedia – Using GPT-2 to synthesize Wikipedi... by LargoLasskhyfv on Thursday January 13, 2022 @04:21PM (#29927044)
Evil! :-)

Have you thought of feeding it facts from https://www.wikidata.org/ and let it construct articles that way?

[ Parent | on HN ]
Re:Show HN: Tensorpedia – Using GPT-2 to synthesize Wikipedi... by JonahSussman on Thursday January 13, 2022 @05:59PM (#29928227)
I thought about using wikidata, but I'm not quite sure how I would feed it into the neural network. It's definitely a possibility though!
[ Parent | on HN ]