News for hackers. Stuff that matters.
Re:The genie escapes: Stanford copies the ChatGPT AI for les... by superkuh on Monday March 20, 2023 @10:59PM (#35242048)
I've tried all sorts of parameters including those exact ones. As for the huggingface stuff, it's not exactly clear how to use it without going down the python dependency rabbit hole. I am not confident I could get the correct python packages all together on Debian 11 to support running it. The llama.cpp stuff is very simple to compile and run comparatively.

There are no comments on this comment yet.