Patterns for Building LLM-Based Systems and Products

Re:Patterns for Building LLM-Based Systems and Products by rolisz on Wednesday August 02, 2023 @03:23AM (#36968016)

1) Dropbox can be replicated in a couple of hours with SFTP (or whatever was that iconic HN comment) 2) the devil is in the details. How do you get the data out of documents? Are they pdfs? Do they have tables? Do they have images? Sure, creating embeddings from text is simple and shoving that into a prompt to get an answer is easy, but getting that text out from different documents can be tricky.

Source: finished a chat to your documents project a month ago

[ Parent | on HN ]

Re:Patterns for Building LLM-Based Systems and Products by ilaksh on Wednesday August 02, 2023 @03:26AM (#36968026)

I guess my point was really not to try to emphasize that chat with documents was particular easy for every application but rather just to suggest that the article wasn't particularly practical advice for common use cases.

[ Parent | on HN ]

Re:Patterns for Building LLM-Based Systems and Products by rolisz on Wednesday August 02, 2023 @03:38AM (#36968092)

Hard disagree. Evaluation is hard. Handling stupid mistakes from LLMs is something that has to be taken into account from day 1.

Finetuning is not that needed in my experience.

[ Parent | on HN ]

Re:Patterns for Building LLM-Based Systems and Products by kristianp on Wednesday August 02, 2023 @05:50PM (#36978142)

>SFTP

rsync

[ Parent | on HN ]