Re:Blender moves from Phabricator to Gitea
by techknowlogick on Tuesday February 07, 2023 @06:52PM
(#34701768)
Thanks, yeah. We have started to look at that alternative endpoint, but it doesn't have the exact data as the api, nor is it always in the exact same format.
Although as I have run the migration myself several times to attempt to debug issues, it takes over 24hours due to ratelimiting.
Disclaimer: I'm one of the members of the technical oversight committee of the Gitea project, and am employed to work on Gitea.
Re:Blender moves from Phabricator to Gitea
by bastardoperator on Tuesday February 07, 2023 @07:01PM
(#34701866)
Create more GitHub Apps. If you're hitting rate limits you can double your capacity by adding a new app and using round robin to cycle through requests/tokens. If you're using a PAT, you only have 5k requests and will bottleneck quickly.
Re:Blender moves from Phabricator to Gitea
by techknowlogick on Tuesday February 07, 2023 @08:34PM
(#34702899)
I.... uhh... can't say I tried that... as it's against the TOS... cough All joking aside, they have banned accounts from other projects attempting to do the same, so if I were to do that (and I'm not saying that I would), I'd want to make sure that the exporter is solid prior to risking any account.
Re:Blender moves from Phabricator to Gitea
by bastardoperator on Tuesday February 07, 2023 @11:28PM
(#34704141)
It's not against the TOS, the documentation is very clear:
"Keep these ideas in mind when creating GitHub Apps:
- A user or organization can own up to 100 GitHub Apps."
Which is 1.5 million API requests per org per hour.
https://docs.github.com/en/rest/migrations/orgs#start-an-org...
https://docs.github.com/en/rest/migrations/orgs#download-an-...
Using a Github App you get 15K requests per hour. Even with pagination(100 records per request) you should be able to get at all of this data within a couple of hours. I suspect you lack reliable transformation tools to take github metadata and convert it to gitea versus the limitations of GitHub.