Re:A college student reached $64k/mo in 6 months by being an...
by rShergold on Wednesday May 24, 2023 @03:48PM
(#36063067)
How does Docalysis.com work? I'm presuming you take the user input then search the documents for matching words to get snippets then add the snippets to a prompt (along with the original query) you send to an LLM.
What does the cost look like? Are you running your own llama.cpp or just using the ChatGPT API?
His product gives you a few thousand tokens for free, then makes you add your own OpenAI API key after that, so that he isn't paying for the chat responses from then on.