News for hackers. Stuff that matters.
Re:Anthropic announces Claude 2.1 – 200k context, less refusals by avita1 on Tuesday November 21, 2023 @05:23PM (#38371268)
Is this practically true? Yes, anyone can clone any repo from Github, but surely scraping all of Github would run into rate limits?

The terms and conditions say as much https://docs.github.com/en/site-policy/github-terms/github-t...

Re:Anthropic announces Claude 2.1 – 200k context, less refusals by vineyardmike on Tuesday November 21, 2023 @07:57PM (#38373093)
Well today you get to learn about the GitHub Archive project, which creates dumps of all GitHub data.

One example is the data hosted in Google Cloud.

https://cloud.google.com/blog/topics/public-datasets/github-...