GITLAB not coming up after VM restart

Hi,

After reboot of VM, I’m facing issues during gitlab services. can someone help on it.

[root@GIT-SSO ~]# sudo gitlab-ctl start
timeout: down: alertmanager: 0s, normally up, want up
ok: run: gitaly: (pid 12524) 0s
ok: run: gitlab-exporter: (pid 12537) 1s
ok: run: gitlab-kas: (pid 12540) 0s
ok: run: gitlab-workhorse: (pid 12549) 1s
ok: run: logrotate: (pid 12558) 0s
ok: run: nginx: (pid 12564) 0s
timeout: down: node-exporter: 0s, normally up, want up
ok: run: postgres-exporter: (pid 12771) 0s
ok: run: postgresql: (pid 12845) 0s
timeout: down: prometheus: 1s, normally up, want up
ok: run: puma: (pid 13002) 0s
timeout: down: redis: 0s, normally up, want up
timeout: down: redis-exporter: 0s, normally up, want up
ok: run: sidekiq: (pid 13429) 0s

[root@GIT-SSO ~]# sudo gitlab-ctl restart
timeout: down: alertmanager: 0s, normally up, want up
ok: run: gitaly: (pid 9657) 0s
ok: run: gitlab-exporter: (pid 9671) 0s
ok: run: gitlab-kas: (pid 9748) 0s
ok: run: gitlab-workhorse: (pid 9759) 0s
ok: run: logrotate: (pid 9775) 1s
ok: run: nginx: (pid 9781) 0s
ok: run: node-exporter: (pid 10068) 0s
ok: run: postgres-exporter: (pid 10275) 0s
ok: run: postgresql: (pid 10389) 0s
ok: run: prometheus: (pid 10479) 0s
ok: run: puma: (pid 10483) 0s
ok: run: redis: (pid 10688) 0s
ok: run: redis-exporter: (pid 10690) 0s
ok: run: sidekiq: (pid 10697) 0s
[root@GIT-SSO ~]# sudo gitlab-ctl status
down: alertmanager: 0s, normally up, want up; run: log: (pid 1449) 979s
run: gitaly: (pid 9657) 134s; run: log: (pid 1451) 980s
run: gitlab-exporter: (pid 9671) 134s; run: log: (pid 1452) 980s
run: gitlab-kas: (pid 9748) 123s; run: log: (pid 1416) 980s
run: gitlab-workhorse: (pid 9759) 123s; run: log: (pid 1421) 980s
run: logrotate: (pid 9775) 123s; run: log: (pid 1447) 980s
run: nginx: (pid 9781) 122s; run: log: (pid 1435) 980s
down: node-exporter: 0s, normally up, want up; run: log: (pid 1443) 980s
down: postgres-exporter: 1s, normally up, want up; run: log: (pid 1445) 980s
down: postgresql: 1s, normally up, want up; run: log: (pid 1429) 980s
run: prometheus: (pid 10846) 0s; run: log: (pid 1419) 980s
run: puma: (pid 10749) 11s; run: log: (pid 1424) 980s
down: redis: 0s, normally up, want up; run: log: (pid 1441) 980s
down: redis-exporter: 1s, normally up, want up; run: log: (pid 1428) 980s
run: sidekiq: (pid 10697) 17s; run: log: (pid 1426) 980s

Hi there
You’ll need to take a look at the logs either using these while gitlab is restarting

sudo gitlab-ctl tail alertmanager
sudo gitlab-ctl tail node-exporter
sudo gitlab-ctl tail postgres-exporter
sudo gitlab-ctl tail postgresql
sudo gitlab-ctl tail redis
sudo gitlab-ctl tail redis-exporter

or open up these logs manually, they should be in /var/log/gitlab and look for clues there

Thankyou, by checking logs cleared my issue.

Which was? Please share as it might helps others facing a similar issue.

These was error which I got from logs.

==> /var/log/gitlab/redis-exporter/current <==
2024-02-25_09:44:56.94468 chpst: fatal: unable to run: /opt/gitlab/embedded/bin/redis_exporter: access denied
2024-02-25_09:44:57.94840 chpst: fatal: unable to run: /opt/gitlab/embedded/bin/redis_exporter: access denied