News for hackers. Stuff that matters.
Re:Ask HN: How should I burn $8k for Google Gemini 1.5 Pro? by reneberlin on Monday June 10, 2024 @08:02PM (#40640745)
That's not how you do it. You use a Vectordatabase and a Retriever. This way, not all tokens of a document are used with the prompt, just the relevant parts will end up in the conversation / prompts. This way you save a lot of money and you are NOT limited to use GoogleAI - you can use whatever AI you want.
Re:Ask HN: How should I burn $8k for Google Gemini 1.5 Pro? by infecto on Monday June 10, 2024 @09:08PM (#40641158)
This is probably how you would do entity extraction. Why would you rag on entity extraction?