GitLab sees huge spike in project imports

Re:GitLab sees huge spike in project imports by verelo on Sunday June 03, 2018 @09:10PM (#17223666)

Irony is that the page this post links to is 502’ing right now. Disappointing...

[ Parent | on HN ]

Re:GitLab sees huge spike in project imports by dblessing on Sunday June 03, 2018 @10:16PM (#17224023)

Sorry about that. The 502 was only on our public monitoring dashboard for a short time. GitLab.com itself is up and running and the monitoring dashboard is back online now.

[ Parent | on HN ]

Re:GitLab sees huge spike in project imports by tazard on Sunday June 03, 2018 @10:57PM (#17224224)

Still seems down for me. Getting a 502

[ Parent | on HN ]

Re:GitLab sees huge spike in project imports by dblessing on Sunday June 03, 2018 @11:23PM (#17224342)

It went down again for a short time. We're continuing to monitor and adjust resources as needed. We weren't expecting this traffic to our monitoring dashboard, but it's great that so many people are interested in taking a look.

[ Parent | on HN ]

Re:GitLab sees huge spike in project imports by FuckOffNeemo on Monday June 04, 2018 @12:44AM (#17224724)

Is your monitoring page a recent build, is it scaling well?

I ask because it's not a particularly good luck that the viewers from HN are capable of bad gateway hug of deaths to the site?

[ Parent | on HN ]

Re:GitLab sees huge spike in project imports by ReidZB on Monday June 04, 2018 @12:58AM (#17224784)

It sounds like it's a separate, single instance. Definitely doesn't use the same infrastructure as gitlab.com itself (which is a good thing, since that's what it's monitoring), nor is it built to be scalable really. So, no great surprise that HN-level traffic overpowered the instance.

I do hope they're using Prometheus federation to expose this instance to the fickle internet and that they have one or more internal Prometheus instances that aren't directly queried by this instance. After all, that stuff is responsible for paging if something goes wrong in prod.

[ Parent | on HN ]

Re:GitLab sees huge spike in project imports by SuperQue on Monday June 04, 2018 @06:04AM (#17226235)

It is a separate instance from our internal one. We have a cron job that automatically copies the internal Grafana dashboards to the public one, so you still see exactly what we see.

We used to use Federation, but now we just have the public server scrape the same targets as our private one.

I'm adding a caching proxy (https://github.com/Comcast/trickster) to the public server now to improve performance. :-)

[ Parent | on HN ]

Re:GitLab sees huge spike in project imports by andr3 on Sunday June 03, 2018 @09:19PM (#17223717)

https://twitter.com/gitlabstatus/status/1003439258814877697?...

This link is for the monitoring page. The imports are going through.

[ Parent | on HN ]

Re:GitLab sees huge spike in project imports by bearjaws on Monday June 04, 2018 @07:33AM (#17226780)

To be fair the page worked fine until it was hugged by HN / Reddit...

[ Parent | on HN ]