News for hackers. Stuff that matters.
Re:Gwern Branwen – How an Anonymous Researcher Predicted AI'... by nutanc on Friday November 15, 2024 @01:02AM (#42144308)
It's a new approach I am experimenting with.

https://gpt3experiments.substack.com/p/a-new-chunking-approa...

Re:Gwern Branwen – How an Anonymous Researcher Predicted AI'... by maujim on Friday November 15, 2024 @02:05PM (#42149835)
Interesting approach. Have you tried using existing clustering algorithms to determine the chunks instead of using distance or slope as a measure?