Re:Show HN: Tensorpedia – Using GPT-2 to synthesize Wikipedi...
by JonahSussman on Thursday January 13, 2022 @03:36PM
(#29926480)
Hey HN! I've been lurking for a while now and I've finally created something that I feel is worth sharing.
I've called this project "Tensorpedia." At its core, Tensorpedia takes in a title and utilizes it as a prompt for GPT-2 to synthesize the introductory part of a Wikipedia article. The machine learning stuff is written using a wonderful library called aitextgen [0], using Wikipedia's "Vital Articles" as a data set [1]. The server is written in Node, and it uses Redis as an article cache. If you want to read my article about it (for some reason), you can check it out here [2].
I created this project to get more experience with server technologies. While I wouldn't say it's a complicated application, I learned quite a lot from it.
Additionally, as I was inspired by all of those this-x-doesn't-exist projects from a while back, this project is mostly for fun. As such, I don't know how much practical use it has, but I've generated some pretty hilarious articles from it.
Re:Show HN: Tensorpedia – Using GPT-2 to synthesize Wikipedi...
by iggldiggl on Friday January 14, 2022 @06:30AM
(#29933177)
Great idea, although it's a bit annoying that none of the article links works as an actual link, so I can't easily open pages in a new tab like I often do when reading a Wikipedia article.
Re:Show HN: Tensorpedia – Using GPT-2 to synthesize Wikipedi...
by JonahSussman on Thursday January 13, 2022 @06:03PM
(#29928262)
I had a good chuckle putting my colleague's names in it - everyone was a superstar, famous poet, or swimmer of some sort. Any good ones you wouldn't mind sharing?
I've called this project "Tensorpedia." At its core, Tensorpedia takes in a title and utilizes it as a prompt for GPT-2 to synthesize the introductory part of a Wikipedia article. The machine learning stuff is written using a wonderful library called aitextgen [0], using Wikipedia's "Vital Articles" as a data set [1]. The server is written in Node, and it uses Redis as an article cache. If you want to read my article about it (for some reason), you can check it out here [2].
I created this project to get more experience with server technologies. While I wouldn't say it's a complicated application, I learned quite a lot from it.
Additionally, as I was inspired by all of those this-x-doesn't-exist projects from a while back, this project is mostly for fun. As such, I don't know how much practical use it has, but I've generated some pretty hilarious articles from it.
[0] https://github.com/minimaxir/aitextgen
[1] https://en.wikipedia.org/wiki/Wikipedia:Vital_articles/Level...
[2] https://jonahsussman.net/posts/2022-01-this-wiki-dne/
Have you thought of feeding it facts from https://www.wikidata.org/ and let it construct articles that way?