Re:OpenCoder: Open Cookbook for Top-Tier Code Large Language...
by Kubuxu on Sunday November 10, 2024 @04:20AM
(#42099245)
Probably forks/duplicates of repos in the dataset.
[ Parent
| on HN ]
Re:OpenCoder: Open Cookbook for Top-Tier Code Large Language...
by ebalit on Sunday November 10, 2024 @08:35AM
(#42100136)
Also commits. I imagine that there is a lot of information to gather from the history of repos in addition to the "static view" of a codebase.
However, it doesn't seem trivial to do deduplication in that case without removing relevant/necessary context.