Re:Ask HN: Have AI learn my own business Knowledge(verity of...
by crazymoka on Tuesday July 30, 2024 @03:50PM
(#41113425)
I can put all the content into text. Would putting it all into json or cvs with headers be helpful? Break down content by topic, categories, links to other pages if it needs to read other content?
Re:Ask HN: Have AI learn my own business Knowledge(verity of...
by kingkongjaffa on Tuesday July 30, 2024 @04:26PM
(#41113773)
Yeah whatever will give you accurate vector embeddings.
You’ll combine those json properties into one vector.
For links you might hard code those as an extra part of each object or potentially require another API call to retrieve relevant links from your “link store”.
It’s useful to have benchmarks in place like:
input “should equal” output And start building a suite of test cases to evaluate your set up.
Re:Ask HN: Have AI learn my own business Knowledge(verity of...
by ndr_ on Tuesday July 30, 2024 @06:13PM
(#41114636)
Depends on the budget, I’d say. If it’s less than 10¢, that may be true. If it‘s 15¢ or more, you could try training with OpenAI:
https://ndurner.github.io/training-own-model-finetuning
Re:Ask HN: Have AI learn my own business Knowledge(verity of...
by cranberryturkey on Wednesday July 31, 2024 @02:02AM
(#41116714)
> shove it in a RAG system for the LLM chatbot to work with
how would I do this with an ollama model?
Re:Ask HN: Have AI learn my own business Knowledge(verity of...
by kingkongjaffa on Friday August 02, 2024 @08:44AM
(#41138395)
You want to ingest your input documents and generate embeddings using an embedding model like https://ollama.com/blog/embedding-models
Since you have multi format data you likely want a pipeline to convert it all to text using various tools, make sure it’s structured and then shove it in a RAG system for the LLM chatbot to work with.
You can get started with lang chain and openAI’s API
Experiment with gpt4o mini for a while to keep costs down and then test if cranking up to gpt4o proper is worth it.
That’s the LLM part solved. You’ll need to control the logic after that depending on controls in your chatbot pop-up window to be able to arrange the calls/send emails etc.