Re:Show HN: OpenCopilot – Build Your Open-Source Copilot in ...
by decodebytes on Tuesday August 22, 2023 @11:56AM
(#37224569)
Which LLM are you using?
[ Parent
| on HN ]
Re:Show HN: OpenCopilot – Build Your Open-Source Copilot in ...
by MourningWood on Tuesday August 22, 2023 @12:07PM
(#37224714)
Looks like gpt4
Re:Show HN: OpenCopilot – Build Your Open-Source Copilot in ...
by michaelmior on Tuesday August 22, 2023 @12:52PM
(#37225423)
For the time being, it looks like you can choose between gpt-3.5-turbo-16k and gpt-4.
https://github.com/opencopilotdev/opencopilot/blob/d7aa8270d...
Re:Show HN: OpenCopilot – Build Your Open-Source Copilot in ...
by sq42na on Tuesday August 22, 2023 @01:43PM
(#37226156)
Yep, currently gpt-3.5-16k or gpt-4. We wrote the example prompts in a relatively Llama-compatible way though (we actually started building this onto Llama 1 before switching to OpenAI as default), and make few assumptions about the LLM so it's easy to switch out. Mostly this is waiting behind us adding an option to pass in any LLM, and we're planning to add support for this.
Generally, we leave the LLM up to the user -- if OpenAI or Google is a no-go, then you probably are anyway in the territory of self-hosting or even self-training your LLM, which means you're fine setting up your own inference endpoints as well.