Re:Show HN: Chonkie – A Fast, Lightweight Text Chunking Libr...
by bhavnicksm on Sunday November 10, 2024 @01:27PM
(#42101672)
Right now, we haven't worked on adding support for code -- some things like comments (#, //) have punctuations that adversely affect chunking, along with indentation and other issues.
But, it's on the roadmap, so please hold on!