News for hackers. Stuff that matters.
Re:Show HN: LlamaGPT – Self-hosted, offline, private AI chat... by dicriseg on Thursday August 17, 2023 @12:21PM (#37164076)
I put up a draft PR to demo how to run it on a GPU: https://github.com/getumbrel/llama-gpt/pull/11

It breaks other things like model downloading, but once I got it to a working state for myself, I figured why not put it up there in case its useful. If I have time, I'll try to rework it a little bit with more parameters and less dockerfile repetition to fit the main project better.

There are no comments on this comment yet.