News for hackers. Stuff that matters.

A comment on OpenLLM. Parent comment

Re:OpenLLM by PcChip on Monday June 19, 2023 @02:19PM (#36394679)
Let's say I wanted to use one of their quantized models with this OpenLLM project. How would I do that?
[ Parent | on HN ]
Re:OpenLLM by Aerroon on Monday June 19, 2023 @04:03PM (#36395846)
Sorry, I don't know. I suspect that it's not possible (yet?). OpenLLM lists a bunch of models in the Github Readme. I think the best way would be to use those for now.
[ Parent | on HN ]