News for hackers. Stuff that matters.

A comment on Show HN: Open-Source DocumentAI with Ollama.

Re:Show HN: Open-Source DocumentAI with Ollama by car on Saturday March 08, 2025 @01:53AM (#43298104)
Could this work with llama.cpp, since it’s the engine behind Ollama?

I usually build llama.cpp from source and download quantized (GGUF) models from Huggingface, haven’t used Ollama this far.

[ Parent | on HN ]
Re:Show HN: Open-Source DocumentAI with Ollama by Dontizi on Saturday March 08, 2025 @02:01AM (#43298132)
No, for now, I’ve only made it work with Ollama, but it could be ideal to do it directly on llama.cpp. Thank you, I’ll take note of it.
[ Parent | on HN ]
Re:Show HN: Open-Source DocumentAI with Ollama by car on Saturday March 08, 2025 @03:02AM (#43298435)
That would be great. Llama.cpp’s built in server offers HTTP embedding endpoints.
[ Parent | on HN ]