News for hackers. Stuff that matters.

A comment on Localllm lets you develop gen AI apps on local CPUs. Parent comment

Re:Localllm lets you develop gen AI apps on local CPUs by smcleod on Wednesday February 07, 2024 @08:38PM (#39296788)
I think you might be thinking of litellm? OpenAI is for OpenAI.com (although you can override the base URL it’s far from ideal).
[ Parent | on HN ]
Re:Localllm lets you develop gen AI apps on local CPUs by Tostino on Wednesday February 07, 2024 @09:43PM (#39297262)
What do you mean "far from ideal"? It's literally just passing in your services URL rather than using the default when instantiating the client. Something you will need to do with any client you use.
[ Parent | on HN ]