News for hackers. Stuff that matters.
Re:Embeddings: What they are and why they matter by jn2clark on Wednesday October 25, 2023 @02:18AM (#38009732)
Try this https://github.com/marqo-ai/marqo which handles all the chunking for you (and is configurable). Also handles chunking of images in an analogous way. This enables highlighting in longer docs and also for images in a single retrieval step.

There are no comments on this comment yet.