Show HN: AnythingLLM – Open-Source, All-in-One Desktop AI Assistant

Re:Show HN: AnythingLLM – Open-Source, All-in-One Desktop AI... by CuriouslyC on Thursday September 05, 2024 @01:39PM (#41458843)

I noticed you put LiteLLM in your list of providers. Was that just marketing, or did you re-implement model support for all the models LiteLLM already supports separately?

[ Parent | on HN ]

Re:Show HN: AnythingLLM – Open-Source, All-in-One Desktop AI... by tcarambat1010 on Thursday September 05, 2024 @02:34PM (#41459284)

You can use LiteLLM _as the LLM provider_ which is just a relay to a ton of other models. For people who already have it set up connecting to x,y,z providers can keep that work and use it for inferencing as well

[ Parent | on HN ]