News for hackers. Stuff that matters.
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by bealuga on Tuesday March 28, 2023 @09:11PM (#35350663)
Hi Hacker News!

My name is Bea, I built a site called Libraria that uses GPT to do a few things

1. Let you spin up multiple assistants based on your own documents. You can make it public, private, or protected. It has its own subdomain and landing page. 2. Respond in full markdown always, so it can output images, links, code, and more 3. Let you upload articles on the fly within the Chat, so you can ask it questions 4. Make it embeddable in your site with one line of code 5. Let you update it for fun / with your branding 5. Enable syncing for any URLs you let us scrape, so that you can make sure it's always up to date 6. Let you upload multiple file types

I've been working on this for about a month now by myself and you can keep track of my feature updates here: https://libraria.dev/feature-updates

I would LOVE your feedback on anything, and If you're willing to try it out I'm looking for a few beta users that can provide me more continuous feedback that I would gladly waive the fee for!

Re:Show HN: Customizable, embeddable Chat GPT based on your ... by ElFitz on Wednesday March 29, 2023 @01:40AM (#35353089)
Providing the sources is a nice touch! I really like it. Providing supporting excerpts too would have been nice.

Isn’t publicly hosting some specific content on S3 and providing links to it risky though?

Re:Show HN: Customizable, embeddable Chat GPT based on your ... by bealuga on Wednesday March 29, 2023 @03:31AM (#35353819)
good callout - I had it setup to delete immediately after processing, but looks like there was an issue on my end for that! Fixed now and deleted ones that were uploaded before. s3 was storing manual uploads (not data scraped from urls), and should not be storing them anymore.
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by dash2 on Tuesday March 28, 2023 @11:12PM (#35351830)
I wonder if you’ve considered academics as a target market. We have a lot of pdfs and might like help in “thinking” about them.
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by malborodog on Wednesday March 29, 2023 @02:31AM (#35353406)
Yep. This is such an obvious use case. Have you seen the best thing out there that does this? Where can I load 100gb of pdfs and ask questions about what's in them??
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by ssdspoimdsjvv on Wednesday March 29, 2023 @05:40AM (#35354748)
Yes, this is the next step I'm looking forward to, and what would probably make LLMs really take off. Let me dump my own knowledge base or source code into ChatGPT and have it use that as its source of knowledge. I can only imagine the cost and resources required to train and run these individual models on a large scale must still be prohibitively large.
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by bealuga on Wednesday March 29, 2023 @03:35AM (#35353851)
That would be really really cool if I could able to serve that space. I'd be curious to know what kind of features you'd want to have, what would be deal-breakers, etc!
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by MaxikCZ on Wednesday March 29, 2023 @04:53AM (#35354392)
Not person with original question but he asks for the same feature as I would like to see.

I am not sure how the documents are handled in your product, since Chat GPT has a context limit that probably wont be able to hold longer papers in memory.

For me, I have a pdf[0] depicting a system that can be programmed, along with bits of pseudo-code and a lot of clarifications. Something that the Chat GPT could use to spit out an actual implementation, if it were able to "think" about the pdf as a whole. I would love to see if your product is capable of such feat.

[0]: https://arrow.tudublin.ie/cgi/viewcontent.cgi?article=1177&c...

Drive-Based Utility-Maximizing Computer Game Non-Player Characters by Colm Sloan (note that basically only chapter 3 is needed in this case, but its still over 40 pages long)

Re:Show HN: Customizable, embeddable Chat GPT based on your ... by dash2 on Wednesday March 29, 2023 @06:27AM (#35355114)
Basic setup: point it at a folder of PDFs, have it recurse in and read them all, then ask it questions like:

* Summarize these papers on chimpanzee cooperation in the wild. What other papers should I be reading?

* Suggest an interesting master's thesis topic on the early modern economy.

* How good are polygenic scores at predicting educational attainment, and how has this developed over time?

Bonus: integrate it with e.g. google scholar, so it can go and find and read new papers.

Pricing: it is probably easier to start selling this to individual academics. Then when you've got a compelling product and the word is out, you could sell it to the whole lab (at a much higher price because people can put it in their grant budgets).

Gotchas: privacy. Nobody wants their hot unpublished paper to be scooped by a large language model.

Re:Show HN: Customizable, embeddable Chat GPT based on your ... by golergka on Wednesday March 29, 2023 @07:24AM (#35355561)
There's http://chatpdf.com already
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by dash2 on Wednesday March 29, 2023 @10:24AM (#35357742)
Interesting and cool, but here's why serious academics should avoid it:

When you post Contributions, you grant us a license (including use of your name, trademarks, and logos): By posting any Contributions, you grant us an unrestricted, unlimited, irrevocable, perpetual, non-exclusive, transferable, royalty-free, fully-paid, worldwide right, and license to: use, copy, reproduce, distribute, sell, resell, publish, broadcast, retitle, store, publicly perform, publicly display, reformat, translate, excerpt (in whole or in part), and exploit your Contributions (including, without limitation, your image, name, and voice) for any purpose, commercial, advertising, or otherwise, to prepare derivative works of, or incorporate into other works, your Contributions, and to sublicense the licenses granted in this section. Our use and distribution may occur in any media formats and through any media channels.

Re:Show HN: Customizable, embeddable Chat GPT based on your ... by munchler on Wednesday March 29, 2023 @01:13AM (#35352928)
Spelling error on upload page, should be: "Add documents to your library for your assistant to use".
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by noduerme on Tuesday March 28, 2023 @11:57PM (#35352271)
I'm wondering if this is designed only for in-house use, or if it's something intended to be public-facing. If a company were to embed this on their website, say, to answer questions about products for sale...

1. Would there be any way to restrict the conversation with the customer to questions related to the products?

2. What strategies could be used to prevent malicious overuse / spamming / flooding the bot to cost the company money?

Re:Show HN: Customizable, embeddable Chat GPT based on your ... by guldbog on Wednesday March 29, 2023 @12:29AM (#35352586)
Love it! For positioning, I'd look into www.raffle.ai - they've found a very good way to explain why enterprise search is valuable
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by imcoconut on Tuesday March 28, 2023 @10:47PM (#35351646)
This looks awesome. I'd be super interested in testing this out and providing feedback on it. I'm going to make an account and is there an email/link to submit feedback as I use it?
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by bealuga on Tuesday March 28, 2023 @10:52PM (#35351685)
Will be adding my email at the about page! https://libraria.dev/about (vercel takes a few minutes to deploy, but it should be up soon)
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by calculated on Wednesday March 29, 2023 @01:50AM (#35353146)
Great service, Bea! Would it support Databases as a source in the future?
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by bealuga on Wednesday March 29, 2023 @02:29AM (#35353395)
Yes! I'm currently working on it. I'm trying to improve CSV imports right now (current users have large csvs they want to go through)
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by calculated on Wednesday March 29, 2023 @03:37AM (#35353858)
Amazing. Another thing - make it si that we can give you our emails and you can send us updates there so we can track the progress of the app and come back to it when needed.
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by bealuga on Wednesday March 29, 2023 @03:46AM (#35353920)
It's at the very bottom of the page! I'll try to make it more visible tomorrow as well (:
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by highwaylights on Wednesday March 29, 2023 @03:33AM (#35353838)
On the website it states:

“Step 1

Import or sync documents into Libraria, or add API integrations like Google and Shopify (beta). Bring the docs - let GPT-3.5 do the heavy lifting.”

I might be reading it wrong, or might have missed it on the website, but is it actually GPT-3.5 running over those imported documents? (As in, are you using OpenAI or another third party provider in the background?).

If you’re running a local LLM then the privacy implications are clearly pretty different than if you’re essentially sending people’s documents verbatim into an external LLM.

Re:Show HN: Customizable, embeddable Chat GPT based on your ... by monkeydust on Wednesday March 29, 2023 @04:12AM (#35354100)
Also curious before I use.

Tbh I have managed to build this minus the nicer interface using langchain. Was surprisingly easy as someone who doesn't dev daily.

https://blog.langchain.dev/retrieval/

Re:Show HN: Customizable, embeddable Chat GPT based on your ... by bsenftner on Wednesday March 29, 2023 @06:32AM (#35355155)
This is the first "real" app people make after initially getting familiar the OpenAI API. I don't see how this can be sustained without an expensive feature race with the horde of similar services that are appearing, and with more than one programmer.
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by monkeydust on Wednesday March 29, 2023 @06:44AM (#35355242)
Yea I mean it is going to get commoditized to the point where its just an Azure service - throw some docs/links etc, maybe tune some parameters (if your and advanced user) and off you go - Q&A bot against your own material.
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by baq on Wednesday March 29, 2023 @10:13AM (#35357571)
Given their office copilot demo they’ve already got something better.
Re:Show HN: Customizable, embeddable Chat GPT based on your ... by monkeydust on Wednesday March 29, 2023 @10:41AM (#35357975)
Thanks I hadn't got around to watching that yet just did. My to-read/watch list is getting ridiculous now as I just cant keep up with the pace given job/life!

https://www.youtube.com/watch?v=S7xTBa93TX8

Re:Show HN: Customizable, embeddable Chat GPT based on your ... by WastingMyTime89 on Wednesday March 29, 2023 @05:52AM (#35354849)
> If you’re running a local LLM then the privacy implications are clearly pretty different than if you’re essentially sending people’s documents verbatim into an external LLM.

Is it?

You are basically entering a contractual relationship with them regarding the propagation of your document and they are themselves entering a contractual relationship with their suppliers. It's not different from hosting in the cloud.

Do you expect every webapps you use to tell you if they use Azure, AWS or GCP?

Re:Show HN: Customizable, embeddable Chat GPT based on your ... by ceejayoz on Wednesday March 29, 2023 @06:22AM (#35355077)
> Do you expect every webapps you use to tell you if they use Azure, AWS or GCP?

In their privacy policies, yes. And I expect them to have signed a DPA with those and other vendors.

Re:Show HN: Customizable, embeddable Chat GPT based on your ... by WastingMyTime89 on Wednesday March 29, 2023 @09:00AM (#35356606)
I’m downvoted but I still believe the position doesn’t make sense. You state and negotiate the level of protection you want for your data with your direct interlocutor. They then enforce that with their own suppliers.

You are free to want to know the whole chain of companies involved in providing you a service but that’s very unusual.

Re:Show HN: Customizable, embeddable Chat GPT based on your ... by WastingMyTime89 on Wednesday March 29, 2023 @10:15AM (#35357605)
Looking at your answer, I surmised it was a legal obligation and yes, it's indeed part of the European GDPR. I learnt something new today.