News for hackers. Stuff that matters.
Re:Show HN: AI companions stack – create and host your own A... by layoric on Wednesday July 12, 2023 @07:35PM (#36703160)
It doesn't seem to be a major barrier for most (it absolutely is for me). Is there enough of a want/market for tools that integrate with common OSS LLM APIs like oobabooga/Kobold/Novel/vLLM etc? One idea I've been toying with is a BYO model with support for these APIs, eg for IDE integration, brain storming etc. Seems like a good approach to me but how many people would actually bother standing up these LLM engines with APIs to use it?

There are no comments on this comment yet.