Processing 40 TB of code from ~10M projects with a server and Go for $100 (2019)

Re:Processing 40 TB of code from ~10M projects with a server... by CamJN on Monday October 03, 2022 @07:12PM (#33074902)

The ”average person eats 3 spiders a year” factoid is actually just statistical error. The average person eats 0 spiders per year. Spiders Georg, who lives in a cave & eats over 10,000 each day, is an outlier and should not have been counted”

[ Parent | on HN ]

Re:Processing 40 TB of code from ~10M projects with a server... by layer8 on Monday October 03, 2022 @08:04PM (#33075251)

Of course, however given that there are 1.2 million repositories with makefiles, the listed average would mean that they contain 1.8 billion makefiles in total. I doubt that that’s the case.

Also, according to the page, only 59 million of all files are named “Makefile”.

I suspect that the file language recognition has major false positives for the Makefile language.

[ Parent | on HN ]