News for hackers. Stuff that matters.
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by highwaylights on Wednesday March 29, 2023 @03:33AM (#35353838)
On the website it states:

“Step 1

Import or sync documents into Libraria, or add API integrations like Google and Shopify (beta). Bring the docs - let GPT-3.5 do the heavy lifting.”

I might be reading it wrong, or might have missed it on the website, but is it actually GPT-3.5 running over those imported documents? (As in, are you using OpenAI or another third party provider in the background?).

If you’re running a local LLM then the privacy implications are clearly pretty different than if you’re essentially sending people’s documents verbatim into an external LLM.

Re:Show HN: Customizable, embeddable Chat GPT based on your ... by monkeydust on Wednesday March 29, 2023 @04:12AM (#35354100)
Also curious before I use.

Tbh I have managed to build this minus the nicer interface using langchain. Was surprisingly easy as someone who doesn't dev daily.

https://blog.langchain.dev/retrieval/

Re:Show HN: Customizable, embeddable Chat GPT based on your ... by bsenftner on Wednesday March 29, 2023 @06:32AM (#35355155)
This is the first "real" app people make after initially getting familiar the OpenAI API. I don't see how this can be sustained without an expensive feature race with the horde of similar services that are appearing, and with more than one programmer.
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by monkeydust on Wednesday March 29, 2023 @06:44AM (#35355242)
Yea I mean it is going to get commoditized to the point where its just an Azure service - throw some docs/links etc, maybe tune some parameters (if your and advanced user) and off you go - Q&A bot against your own material.
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by baq on Wednesday March 29, 2023 @10:13AM (#35357571)
Given their office copilot demo they’ve already got something better.
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by monkeydust on Wednesday March 29, 2023 @10:41AM (#35357975)
Thanks I hadn't got around to watching that yet just did. My to-read/watch list is getting ridiculous now as I just cant keep up with the pace given job/life!

https://www.youtube.com/watch?v=S7xTBa93TX8

Re:Show HN: Customizable, embeddable Chat GPT based on your ... by WastingMyTime89 on Wednesday March 29, 2023 @05:52AM (#35354849)
> If you’re running a local LLM then the privacy implications are clearly pretty different than if you’re essentially sending people’s documents verbatim into an external LLM.

Is it?

You are basically entering a contractual relationship with them regarding the propagation of your document and they are themselves entering a contractual relationship with their suppliers. It's not different from hosting in the cloud.

Do you expect every webapps you use to tell you if they use Azure, AWS or GCP?

Re:Show HN: Customizable, embeddable Chat GPT based on your ... by ceejayoz on Wednesday March 29, 2023 @06:22AM (#35355077)
> Do you expect every webapps you use to tell you if they use Azure, AWS or GCP?

In their privacy policies, yes. And I expect them to have signed a DPA with those and other vendors.

Re:Show HN: Customizable, embeddable Chat GPT based on your ... by WastingMyTime89 on Wednesday March 29, 2023 @09:00AM (#35356606)
I’m downvoted but I still believe the position doesn’t make sense. You state and negotiate the level of protection you want for your data with your direct interlocutor. They then enforce that with their own suppliers.

You are free to want to know the whole chain of companies involved in providing you a service but that’s very unusual.

Re:Show HN: Customizable, embeddable Chat GPT based on your ... by WastingMyTime89 on Wednesday March 29, 2023 @10:15AM (#35357605)
Looking at your answer, I surmised it was a legal obligation and yes, it's indeed part of the European GDPR. I learnt something new today.