Ollama releases Python and JavaScript Libraries

Re:Ollama releases Python and JavaScript Libraries by rex123 on Thursday January 25, 2024 @08:59AM (#39129594)

Hey - Akash from Zenfetch here. We’ve actually tested some of our features with local models and have found that they significantly underperform compared to hosted models. With that said, we are actively working on new approaches to offer a local version of Zenfetch.

In the meanwhile, we do have agreements in place with all of our AI providers to ensure none of our users information is used for training or any other purpose. Hope that helps!

[ Parent | on HN ]

Re:Ollama releases Python and JavaScript Libraries by reacharavindh on Thursday January 25, 2024 @09:14AM (#39129752)

Hey. Congratulations on your product. I’m guessing it will be greatly useful for your target audience.

I don’t have a serious need that I’d think worth paying for. So, I’m probably not in your target. I wanted to do this for a personal use case.

Throw all my personal documents at a local model and ask very personal questions like “the investment I made on that thing in 2010, how did I do against this other thing?” Or “from my online activity, when did I start focusing on this X tech?” Or even “find me that receipt/invoice from that ebike I purchased in 2021 and the insurance I took out on it”.

There is no way I’m taking the promise of a cloud product and upload all my personal documents to it. Hence my ask about the ability to do this locally - slowly is perfectly fine for my cheap need :-)

[ Parent | on HN ]

Re:Ollama releases Python and JavaScript Libraries by rex123 on Thursday January 25, 2024 @09:28AM (#39129897)

Makes a lot of sense. This might work for your use case: https://khoj.dev/. It's local, free, and open-source.

[ Parent | on HN ]