News for hackers. Stuff that matters.
Re:Localllm lets you develop gen AI apps on local CPUs by Tostino on Wednesday February 07, 2024 @09:43PM (#39297262)
What do you mean "far from ideal"? It's literally just passing in your services URL rather than using the default when instantiating the client. Something you will need to do with any client you use.

There are no comments on this comment yet.