News for hackers. Stuff that matters.
Re:We updated our RSA SSH host key by KirillPanov on Friday March 24, 2023 @04:56AM (#35286654)
> you can subscribe to a stream of ALL events happening at GitHub by fetching from this endpoint: https://api.github.com/events

Wow I am shocked that they allow "firehose" access not only for free, but without even an API key.

Given enough disk and bandwidth, does this mean you could keep your own copy of all of github? I'd love to be able to grep the whole thing.

Re:We updated our RSA SSH host key by jonas-w on Friday March 24, 2023 @05:53AM (#35287007)
Re:We updated our RSA SSH host key by bspammer on Friday March 24, 2023 @06:08AM (#35287095)
The leaked private key should be somewhere in this archive then no?
Re:We updated our RSA SSH host key by jonas-w on Friday March 24, 2023 @06:51AM (#35287378)
The events stream does not contain files or anything in your git repo. Only stuff like commit messages, issues, comments, etc.
Re:We updated our RSA SSH host key by 112 on Friday March 24, 2023 @12:53PM (#35291921)
i think it does contain code
Re:We updated our RSA SSH host key by squeaky-clean on Friday March 24, 2023 @04:07PM (#35294729)
You can view it yourself, it doesn't contain the code directly, but it does contain a link to the code blob.
Re:We updated our RSA SSH host key by KirillPanov on Friday March 24, 2023 @03:03PM (#35293933)
Wow thanks. I looked all over that page but couldn't get a rough idea of the dataset size for the event stream (not the commits).

Are we talking 1TB/year, 10TB/year, 100TB/year?

Re:We updated our RSA SSH host key by jonas-w on Saturday March 25, 2023 @07:43AM (#35301684)
Your comment made me curious. I downloaded the complete last month (February). 28 days, every day has a gzipped json file which is on average 86MB. Summarized it is 53GB of gzipped jsons for 28 days. Roughly 700GB gzipped per year. Didn't have the chance to ungzip them all.