Llamanet: Zero-setup, zero-dependency OpenAI replacement powered by llama.cpp

Re:Llamanet: Zero-setup, zero-dependency OpenAI replacement ... by thecleaner on Sunday June 09, 2024 @06:52PM (#40628285)

OpenAI replacement ? Some really tall claims there. What's the context length for this setup ? And any latency numbers ? If this really is what it says it is, you should shout these numbers.

[ Parent | on HN ]

Re:Llamanet: Zero-setup, zero-dependency OpenAI replacement ... by salade_pissoir on Sunday June 09, 2024 @10:53PM (#40629684)

As an "OpenAI replacement," maybe it ripped off Kathleen Turner's voice instead of Scarlett Johannsen's.

[ Parent | on HN ]

Re:Llamanet: Zero-setup, zero-dependency OpenAI replacement ... by troyvit on Monday June 10, 2024 @10:12AM (#40633891)

They have more information at the link. This is an abstraction layer that allows anybody who is using OpenAI's API to use them instead, and they can point your API requests to any other LLM. This would be good for anybody using OpenAI but who doesn't want to have to worry about being locked in.

[ Parent | on HN ]

Re:Llamanet: Zero-setup, zero-dependency OpenAI replacement ... by cchance on Monday June 10, 2024 @11:38AM (#40634724)

I mean you could click the link and see what it is lol, it's an OpenAI API layer replacement, that allows you to aim it at any llamacpp instance and gguf model

[ Parent | on HN ]