News for hackers. Stuff that matters.

A comment on DuckDuckGo AI Chat. Parent comment

Re:DuckDuckGo AI Chat by lxgr on Friday April 19, 2024 @10:56AM (#40087625)
True, but it's also the best possible thing until they can run an LLM in your browser (or maybe we figure out how to do homomorphic encryption of neural networks).

What else should they call it? I suppose "anonymous" could work (i.e. they only know about you what you tell them).

[ Parent | on HN ]
Re:DuckDuckGo AI Chat by bevekspldnw on Friday April 19, 2024 @11:04AM (#40087729)
They could literally run Mixtral or Llama on their own machines and have total control. This is basically a ChatGPT VPN.
[ Parent | on HN ]
Re:DuckDuckGo AI Chat by lxgr on Friday April 19, 2024 @11:15AM (#40087858)
What would make their machines more trustworthy than OpenAI's or Anthropic's?
[ Parent | on HN ]
Re:DuckDuckGo AI Chat by dumbfounder on Friday April 19, 2024 @11:29AM (#40088054)
Them saying they will not use our data or allow 3rd parties to use our data. This effort is weak sauce.
[ Parent | on HN ]
Re:DuckDuckGo AI Chat by bevekspldnw on Friday April 19, 2024 @11:49AM (#40088312)
Correct, that would be full communications content protection. This is not that, this is a pretty half assed product with a misleading set of promises.

Either use one of the many open models that beat GPT-3.5 and you have a real, and better!, product.

I literally have no idea what the point of this is, or why not make the actual step of rolling out a real private LLM. It’s literally inferior to what Mixtral provides right now, under Apache license.

[ Parent | on HN ]