Gitlab.com CI/CD down? Seeing HTTP 500 and 503 in self-hosted gitlab-runner logs

My pipelines are in pending status according to the UI.
They were working fine until around 18:50h UTC.

There were no changes from my side.

The status page shows Gitlab CI is operational.

I’m seeing the following on my self-hosted gitlab-runner logs:

Runtime platform                                    arch=amd64 os=linux pid=6 revision=2ebc4dc4 version=13.9.0
Starting multi-runner from /etc/gitlab-runner/config.toml...  builds=0
Running in system-mode.                            
                                                   
Configuration loaded                                builds=0
listen_address not defined, metrics & debug endpoints disabled  builds=0
[session_server].listen_address not defined, session endpoints disabled  builds=0
WARNING: Checking for jobs... failed                runner=XXX status=503 Service Unavailable
WARNING: Checking for jobs... failed                runner=XXX status=503 Service Unavailable
WARNING: Checking for jobs... failed                runner=XXX status=503 Service Unavailable
WARNING: Checking for jobs... failed                runner=XXX status=503 Service Unavailable
WARNING: Checking for jobs... failed                runner=XXX status=503 Service Unavailable
WARNING: Checking for jobs... failed                runner=XXX status=503 Service Unavailable
WARNING: Checking for jobs... failed                runner=XXX status=503 Service Unavailable
WARNING: Checking for jobs... failed                runner=XXX status=503 Service Unavailable
WARNING: Checking for jobs... failed                runner=XXX status=503 Service Unavailable
WARNING: Checking for jobs... failed                runner=XXX status=503 Service Unavailable
WARNING: Checking for jobs... failed                runner=XXX status=500 Internal Server Error
WARNING: Checking for jobs... failed                runner=XXX status=503 Service Unavailable
WARNING: Checking for jobs... failed                runner=XXX status=503 Service Unavailable
WARNING: Checking for jobs... failed                runner=XXX status=503 Service Unavailable
WARNING: Checking for jobs... failed                runner=XXX status=503 Service Unavailable
WARNING: Checking for jobs... failed                runner=XXX status=500 Internal Server Error
WARNING: Checking for jobs... failed                runner=XXX status=500 Internal Server Error
WARNING: Checking for jobs... failed                runner=XXX status=500 Internal Server Error
WARNING: Checking for jobs... failed                runner=XXX status=503 Service Unavailable
WARNING: Checking for jobs... failed                runner=XXX status=500 Internal Server Error
WARNING: Checking for jobs... failed                runner=XXX status=503 Service Unavailable

status.gitlab.com just started showing that CI/CD to be in Degraded Performance status.

Closing as redundant.

1 Like

Please see 2021-03-20: Increased Error Rate Across Fleet (#4024) · Issues · GitLab.com / GitLab Infrastructure Team / production · GitLab for additional details and updates.