Re:Play AI Dungeon 2. Become a Dragon. Eat the Moon
by cjbprime on Monday December 16, 2019 @02:35PM
(#21806299)
Is there a way to run it self-hosted locally?
[ Parent
| on HN ]
Re:Play AI Dungeon 2. Become a Dragon. Eat the Moon
by idle_zealot on Monday December 16, 2019 @02:40PM
(#21806363)
Yeah, just clone the repo, download the model, and run the start script. If you don't have a GPU with ~14GB of RAM expect each response to take a few minutes to be generated though.
Re:Play AI Dungeon 2. Become a Dragon. Eat the Moon
by cjbprime on Monday December 16, 2019 @03:16PM
(#21806723)
Thanks! It's not that bad -- am on a 2080 8GB and it takes less than a minute for each response.
Re:Play AI Dungeon 2. Become a Dragon. Eat the Moon
by flatiron on Monday December 16, 2019 @03:39PM
(#21806964)
at least for me it complains my python is too new (arch) so I installed it on a nvidia cuda docker container (which is using 18.04) and for some reason it still complains it can't use CUDA but works fine on the CPU although slow