News for hackers. Stuff that matters.
Re:Embeddings: What they are and why they matter by tayo42 on Wednesday October 25, 2023 @10:59AM (#38013541)
> I've found it frustratingly hard to find really good guidance as to chunking strategies.

Atleast I'm not alone. Paragraph can make sense, I was worried about paragraphs that are related in concepts, they're not always standalone section of thoughts in real writing.

Maybe if two paragraphs meet some similarity threshold you can merge them.

There are no comments on this comment yet.