News for hackers. Stuff that matters.
Re:Ollama are 'try[ing to] achieve vendor lock-in' by free_bip on Friday January 31, 2025 @10:10AM (#42888411)
I don't understand. The quoted text appears nowhere in the linked page.
Re:Ollama are 'try[ing to] achieve vendor lock-in' by lioeters on Friday January 31, 2025 @10:13AM (#42888441)
It's in one of the collapsed comments. Quoted below:

https://github.com/ggerganov/llama.cpp/pull/11016#issuecomme...

So Ollama are basically forking a little bit of everything to try and achieve vendor lock-in. Some examples:

    The Ollama transport protocol, it just a slightly forked version of the OCI protocol (they are ex-Docker guys). Just forked enough so one can't use dockerhub, quay.io, helm, etc. (so people will have to buy Ollama Enterprise servers or whatever).

    They have forked llama.cpp (I would much rather we upstreamed to llama.cpp than forked, like upstreamining to Linus's kernel tree).

    They don't use jinja like everyone else, they use this:
https://ollama.com/library/granite-code/blobs/977871d28ce4

etc.

So we started a project called RamaLama to unfork all these bits

Re:Ollama are 'try[ing to] achieve vendor lock-in' by majormjr on Friday January 31, 2025 @10:52AM (#42888799)
The first 2 points do point to Ollama neglecting the community and not contributing to upstream. For the lack of Jinja templates I would have thought that's just from it being written in Go and using the Go templating engine instead.
Re:Ollama are 'try[ing to] achieve vendor lock-in' by ochafik on Saturday February 01, 2025 @08:16AM (#42898058)
When there's a will, there's a way.

It's a bit silly but I rolled out my own(*) "no-deps" C++ Jinja template library (https://github.com/google/minja) just to add tool call support to llama.cpp (https://github.com/ggerganov/llama.cpp/pull/9639).

(*): I mean, technically my employer's :-D*