Hi,
I’ve recently upgraded gitlab from version 8.11.11 to 11.4.5. It’s working well and I don’t have any issue. The reason for the question is when i check the status of gitlab, I see that the ci-sidkiq process is showing as down, but I don;t see any issues in Gitlab and the CI runner I have still works as it should.
# ./gitlab-ctl status
run: alertmanager: (pid 1856) 691402s; run: log: (pid 1121) 691409s
run: ci-redis: (pid 1115) 691409s; run: log: (pid 1110) 691409s
down: ci-sidekiq: 0s, normally up, want up; run: log: (pid 1133) 691409s
run: ci-unicorn: (pid 14904) 1s; run: log: (pid 1107) 691409s
run: gitaly: (pid 1113) 691409s; run: log: (pid 1109) 691409s
run: gitlab-monitor: (pid 1122) 691409s; run: log: (pid 1120) 691409s
run: gitlab-workhorse: (pid 1130) 691409s; run: log: (pid 1124) 691409s
run: logrotate: (pid 10796) 144s; run: log: (pid 1118) 691409s
run: nginx: (pid 1105) 691409s; run: log: (pid 1104) 691409s
run: node-exporter: (pid 1116) 691409s; run: log: (pid 1102) 691409s
run: postgres-exporter: (pid 1123) 691409s; run: log: (pid 1119) 691409s
run: postgresql: (pid 1114) 691409s; run: log: (pid 1106) 691409s
run: prometheus: (pid 1139) 691409s; run: log: (pid 1131) 691409s
run: redis: (pid 1134) 691409s; run: log: (pid 1132) 691409s
run: redis-exporter: (pid 1129) 691409s; run: log: (pid 1128) 691409s
run: sidekiq: (pid 1117) 691409s; run: log: (pid 1111) 691409s
run: unicorn: (pid 1140) 691409s; run: log: (pid 1137) 691409s
And this is it running:
# ps -ef | grep 1133
root 1133 1094 0 Mar20 ? 00:01:30 svlogd -tt /var/log/gitlab/ci-sidekiq
Checking these logs:
/var/log/gitlab/gitlab-rails/sidekiq.log
2019-03-28_09:30:11.77030 2019-03-28T09:30:11.770Z 1117 TID-ou0411up9 PagesDomainVerificationCronWorker JID-5013e9f36116cdb5c043eff6 INFO: start
2019-03-28_09:30:11.80349 2019-03-28T09:30:11.803Z 1117 TID-ou0411up9
PagesDomainVerificationCronWorker JID-5013e9f36116cdb5c043eff6 INFO: done: 0.033 sec
2019-03-28_09:45:34.73109 2019-03-28T09:45:34.730Z 1117 TID-ou07c7upl PagesDomainVerificationCronWorker JID-e172226b2e97a88b2753119f INFO: start
2019-03-28_09:45:34.78790 2019-03-28T09:45:34.787Z 1117 TID-ou07c7upl PagesDomainVerificationCronWorker JID-e172226b2e97a88b2753119f INFO: done: 0.057 sec
and:
ci-sidekiq/current:2019-03-28_09:45:33.24237 bundler: failed to load command: sidekiq (/opt/gitlab/embedded/bin/sidekiq)
ci-sidekiq/current:2019-03-28_09:45:34.66161 bundler: failed to load command: sidekiq (/opt/gitlab/embedded/bin/sidekiq)
ci-sidekiq/current:2019-03-28_09:45:36.04863 bundler: failed to load command: sidekiq (/opt/gitlab/embedded/bin/sidekiq)
ci-sidekiq/current:2019-03-28_09:45:37.44300 bundler: failed to load command: sidekiq (/opt/gitlab/embedded/bin/sidekiq)
Does anyone have any recommendations?
Thanks.