News for hackers. Stuff that matters.
Re:Gitlab.com was experiencing elevated error rates for Git,... by mondss on Monday March 15, 2021 @07:40AM (#26464748)
I can't be the only one that feels that GitLab has extended downtime at least weekly, sometimes bi-weekly.
Re:Gitlab.com was experiencing elevated error rates for Git,... by wongarsu on Monday March 15, 2021 @08:50AM (#26465449)
Not downtime, but some kind of issue, yes [1]. However github is not much better [2] and gives much less detail and fewer updates. Bitbucket is more solid recently [3] (but wasn't really better than the others in 2020)

1: https://status.gitlab.com/pages/history/5b36dc6502d06804c083...

2: https://www.githubstatus.com/history (don't get fooled by them collapsing the incident list after three per month)

2: https://bitbucket.status.atlassian.com/history (also collapses after three per month)

Re:Gitlab.com was experiencing elevated error rates for Git,... by 0x008 on Monday March 15, 2021 @08:12AM (#26465020)
I use gitlab daily and have not experienced any outage in last 6 months probably.
Re:Gitlab.com was experiencing elevated error rates for Git,... by time0ut on Monday March 15, 2021 @08:40AM (#26465328)
It is usually their shared runners. I experience outages with them a couple times a month. It isn't a big deal since we maintain our own private pool, so I just move jobs to them. (They make you pay for CI minutes so we use them for certain jobs.)
Re:Gitlab.com was experiencing elevated error rates for Git,... by wdb on Monday March 15, 2021 @08:55AM (#26465495)
For me even our private runners stopped worked over the last few weeks
Re:Gitlab.com was experiencing elevated error rates for Git,... by time0ut on Monday March 15, 2021 @09:12AM (#26465672)
Ouch. We haven't seen that, but we don't run them all the time either.
Re:Gitlab.com was experiencing elevated error rates for Git,... by danaris on Monday March 15, 2021 @11:16AM (#26466998)
I use GitLab for my side project (source control only; don't have any kind of CI set up just at the moment) and it's been years since there was any really noticeable slowness for me. I can't say I use it daily, but fairly frequently.
Re:Gitlab.com was experiencing elevated error rates for Git,... by nops on Monday March 15, 2021 @08:35AM (#26465273)
6 months is a pretty low bar for a SCM tool.
Re:Gitlab.com was experiencing elevated error rates for Git,... by roblabla on Monday March 15, 2021 @08:39AM (#26465312)
Github has had frequent downtime too in the last 6 months too. For a low bar, it seems to be fairly hard to clear.
Re:Gitlab.com was experiencing elevated error rates for Git,... by skohan on Monday March 15, 2021 @08:51AM (#26465454)
Same - I've had zero issues.
Re:Gitlab.com was experiencing elevated error rates for Git,... by Jamie9912 on Monday March 15, 2021 @08:16AM (#26465062)
Our self-hosted GitLab instance is running fine!
Re:Gitlab.com was experiencing elevated error rates for Git,... by mikepurvis on Monday March 15, 2021 @08:34AM (#26465260)
Yup; I just updated ours to 13.9.4 and it was seamless as always (EE version).
Re:Gitlab.com was experiencing elevated error rates for Git,... by drcursor on Monday March 15, 2021 @08:47AM (#26465415)
Pitty its licensing cost will go up ten fold next year.
Re:Gitlab.com was experiencing elevated error rates for Git,... by loloquwowndueo on Monday March 15, 2021 @08:50AM (#26465445)
How so? Pics or it didn’t happen.
Re:Gitlab.com was experiencing elevated error rates for Git,... by smcleod on Monday March 15, 2021 @08:55AM (#26465502)
Re:Gitlab.com was experiencing elevated error rates for Git,... by drcursor on Monday March 15, 2021 @08:55AM (#26465505)
Re:Gitlab.com was experiencing elevated error rates for Git,... by sofixa on Monday March 15, 2021 @09:52AM (#26466085)
Only for the paid tiers, free tier stays free.
Re:Gitlab.com was experiencing elevated error rates for Git,... by drcursor on Monday March 15, 2021 @10:23AM (#26466391)
0 ten times fold = 0
Re:Gitlab.com was experiencing elevated error rates for Git,... by stabbles on Monday March 15, 2021 @08:14AM (#26465042)
Github seems to be doing worse
Re:Gitlab.com was experiencing elevated error rates for Git,... by rvz on Monday March 15, 2021 @08:35AM (#26465269)
Yes. They (GitHub) have been doing a lot worse. Last time I checked, they where completely down 2 days ago. [0] Before that, GitHub Actions was down 14 days ago: [1].

At least with GitLab, you can set up a self-hosted solution for free as a backup, unlike GitHub (Unless you want to pay a lot for GH Enterprise) where some have 'gone all in on GitHub Actions' and then some couldn't push that critical change [2] before the start of the weekend. Oh dear.

Maybe its time to setup a self-hosted backup VCS and not depend entirely on GitHub/GitLab web.

[0] https://news.ycombinator.com/item?id=26439075

[1] https://news.ycombinator.com/item?id=26301659

[2] https://news.ycombinator.com/item?id=26439213

Re:Gitlab.com was experiencing elevated error rates for Git,... by tomxor on Monday March 15, 2021 @08:56AM (#26465521)
> Maybe its time to setup a self-hosted backup VCS and not depend entirely on GitHub/GitLab web.

I've been wanting to do this for some time purely for git hosting (don't care about CI at all) but wasn't sure about how to make it failover...

Personally i'd be happy with a headless git server, but that's not fair on everyone else who wants the GUI to browse and organise stuff, so I want gitlab etc to deal with that. What would be nice is to have a headless backup server that allowed everyone to continue pulling/pushing from the CLI with their existing repos when gitlab is down. I can't see a smooth way of doing that since it would require messing with the git remotes, unless the solution is inverted and uses a single remote pointing at the "backup" server which then replicates to gitlab, but I don't think gitlab can be configured to change the default remote when people clone it from the UI.

I suppose this is why people just end up self hosting gitlab instead.

Re:Gitlab.com was experiencing elevated error rates for Git,... by the_duke on Monday March 15, 2021 @09:35AM (#26465903)
If you want transparent failover you need to use your own domain for the repo URL. In case of a failure you (or some automatic job) would have to change the DNS record.

Gitlab has a repo mirroring feature [1]. But of course you'd also need to sync users public keys.

Downtimes are so infrequent and relatively short that this isn't worth the effort for me.

You can instead set up a read-only mirror so people can at least still pull and browse the code.. Gitea [2] might be a better choice than Gitlab, since it's much more lightweight and easier to host.

[1] https://docs.gitlab.com/ce/user/project/repository/repositor...

[2] https://gitea.io

Re:Gitlab.com was experiencing elevated error rates for Git,... by tomxor on Monday March 15, 2021 @10:19AM (#26466370)
Thanks this is useful to know

> Downtimes are so infrequent and relatively short that this isn't worth the effort for me.

That's essentially the same conclusion I keep coming too, occasionally it has hit me when I go to push something but rarely has it blocked me or anyone else from continuing to work.

> You can instead set up a read-only mirror so people can at least still pull and browse the code

Yeah, this I need to do eventually just for peace of mind as a more automated backup solution. At least I don't have to care about failover.

Re:Gitlab.com was experiencing elevated error rates for Git,... by mroche on Monday March 15, 2021 @12:44PM (#26468281)
Maybe some kind of pre/post-push hook to automatically push to a secondary repo? Not entirely sure if this is possible, I’ve never written a Git hook before.

https://git-scm.com/book/en/v2/Customizing-Git-Git-Hooks

Re:Gitlab.com was experiencing elevated error rates for Git,... by wdb on Monday March 15, 2021 @08:52AM (#26465471)
Gitlab is completely down until just now, similar happened not that long ago. Over the last three weeks continuously had issues with the Gitlab runners (even not shared ones) were it wouldn't jobs or only after a second or third retry attempt.

I think the flakiness of jobs succeeding is also related whether you use their package registry. I can't say I had similar issues with Github.

Re:Gitlab.com was experiencing elevated error rates for Git,... by Bombthecat on Monday March 15, 2021 @08:37AM (#26465296)
Well, they are stretching and extending gitlab with more and more functions.. With a... Not so great code base..
Re:Gitlab.com was experiencing elevated error rates for Git,... by joana035 on Monday March 15, 2021 @08:48AM (#26465420)
Is there any code base in this world that developers would not complain about? ;)
Re:Gitlab.com was experiencing elevated error rates for Git,... by brodock on Monday March 15, 2021 @09:01AM (#26465568)
The only perfect code is the one you write, all others are crap
Re:Gitlab.com was experiencing elevated error rates for Git,... by KptMarchewa on Monday March 15, 2021 @08:51AM (#26465466)
The one that will never be deployed on production. Real world unfortunately corrupts beautiful code with it's pesky complications.
Re:Gitlab.com was experiencing elevated error rates for Git,... by rataata_jr on Monday March 15, 2021 @09:09AM (#26465641)
Xmonad
Re:Gitlab.com was experiencing elevated error rates for Git,... by dnsmichi on Monday March 15, 2021 @08:46AM (#26465396)
Hi, what could be improved in GitLab's code base in your opinion? :)
Re:Gitlab.com was experiencing elevated error rates for Git,... by YorickPeterse on Monday March 15, 2021 @08:49AM (#26465429)
In the past people have suggested we rewrite GitLab in Scala, Haskell, Node.js, and IIRC also regular Java.

I think it mostly comes down to "I didn't write it, so it's bad" :)

Re:Gitlab.com was experiencing elevated error rates for Git,... by Bombthecat on Monday March 15, 2021 @09:12AM (#26465674)
Nah, i don't care which language. Like, at all. I just think that gitlab outgrow ruby.
Re:Gitlab.com was experiencing elevated error rates for Git,... by searchableguy on Monday March 15, 2021 @08:56AM (#26465509)
Suprised no rust or elixir there.
Re:Gitlab.com was experiencing elevated error rates for Git,... by dt5702 on Monday March 15, 2021 @08:10AM (#26465008)
Do you have info on how different providers stack up?
Re:Gitlab.com was experiencing elevated error rates for Git,... by bromonkey on Monday March 15, 2021 @08:13AM (#26465032)
*any non self-hosted git provider
Re:Gitlab.com was experiencing elevated error rates for Git,... by RicoElectrico on Monday March 15, 2021 @08:11AM (#26465015)
Obligatory "is bi-weekly 2 or 0.5 times a week" confusion comment ;)

Though from the context it's 2.

Re:Gitlab.com was experiencing elevated error rates for Git,... by Jenk on Monday March 15, 2021 @08:13AM (#26465029)
This is why we have "fortnightly" in the English language.
Re:Gitlab.com was experiencing elevated error rates for Git,... by herodoturtle on Monday March 15, 2021 @08:32AM (#26465244)
TIL:

"A fortnight is a unit of time equal to 14 days (2 weeks). The word derives from the Old English term fēowertyne niht, meaning "fourteen nights".

https://en.wikipedia.org/wiki/Fortnight

Re:Gitlab.com was experiencing elevated error rates for Git,... by KptMarchewa on Monday March 15, 2021 @08:52AM (#26465474)
Or just say "twice a week" and "once every two weeks" and not leave everyone in a meeting thinking you're talking about popular video game.
Re:Gitlab.com was experiencing elevated error rates for Git,... by ntechau on Monday March 15, 2021 @08:23AM (#26465144)
ok
Re:Gitlab.com was experiencing elevated error rates for Git,... by kweinber on Monday March 15, 2021 @08:40AM (#26465331)
Like it or not, fortnightly and “once every two weeks” are your only unambiguous choices.

We actually had a programming interview question using biweekly at a previous job. It was about thorough requirements definition and understanding/agreeing to measurements.

Re:Gitlab.com was experiencing elevated error rates for Git,... by aufhebung on Monday March 15, 2021 @08:32AM (#26465243)
The word fortnight is in common parlance. Four score is not. But for the record the term bi-weekly is still confusing.