I have inherited a gitlab server that I am supposed to upgrade. The server is running CentOS 6 and Gitlab 13.5.3 CE which I understand was installed using Docker. Since this box has never had a restore tested I want to first try the upgrade on a different server. I obtained a second CentOS 6 box and copied all the /opt/gitlab files as well as what I could find that seemed to be important in /etc/ from the old server over to the “new” server. I changed the name in reconfigure and everything seemed to be ok. But I am getting permission errors when I try to run it and a couple of parts are not installing.
[root@old-rainier conf]# /opt/gitlab/bin/gitlab-ctl status
down: alertmanager: 0s, normally up, want up; run: log: (pid 4912) 2322353s
run: gitaly: (pid 23200) 5592s; run: log: (pid 4340) 2322370s
run: gitlab-exporter: (pid 23228) 5592s; run: log: (pid 4866) 2322355s
run: gitlab-workhorse: (pid 23239) 5591s; run: log: (pid 4769) 2322359s
down: grafana: 0s, normally up, want up; run: log: (pid 4925) 2322351s
run: logrotate: (pid 19372) 1960s; run: log: (pid 4718) 2322361s
run: nginx: (pid 23867) 5560s; run: log: (pid 4814) 2322357s
run: node-exporter: (pid 23873) 5559s; run: log: (pid 4862) 2322355s
run: postgres-exporter: (pid 23892) 5559s; run: log: (pid 4923) 2322352s
run: postgresql: (pid 23898) 5558s; run: log: (pid 4443) 2322367s
down: prometheus: 1s, normally up, want up; run: log: (pid 4906) 2322353s
run: puma: (pid 5148) 25s; run: log: (pid 4744) 2322360s
run: redis: (pid 24066) 5552s; run: log: (pid 4296) 2322371s
run: redis-exporter: (pid 24084) 5552s; run: log: (pid 4896) 2322354s
run: sidekiq: (pid 24107) 5551s; run: log: (pid 4763) 2322359s
[root@old-rainier conf]#
Here are some log messages from the tail file.
==> /var/log/gitlab/alertmanager/current <==
2023-12-12_20:52:28.84762 level=info ts=2023-12-12T20:52:28.847Z caller=cluster.go:161 component=cluster msg=“setting advertise address explicitly” addr=10.96.224.67 port=9094
2023-12-12_20:52:28.84858 level=error ts=2023-12-12T20:52:28.848Z caller=main.go:261 err=“open /var/opt/gitlab/alertmanager/data/nflog: permission denied”
2023-12-12_20:52:29.91070 level=info ts=2023-12-12T20:52:29.910Z caller=main.go:216 msg=“Starting Alertmanager” version=“(version=0.21.0, branch=master, revision=)”
2023-12-12_20:52:29.91077 level=info ts=2023-12-12T20:52:29.910Z caller=main.go:217 build_context=“(go=go1.14.7, user=GitLab-Omnibus, date=)”
2023-12-12_20:52:29.91154 level=info ts=2023-12-12T20:52:29.911Z caller=cluster.go:161 component=cluster msg=“setting advertise address explicitly” addr=10.96.224.67 port=9094
2023-12-12_20:52:29.91252 level=error ts=2023-12-12T20:52:29.912Z caller=main.go:261 err=“open /var/opt/gitlab/alertmanager/data/nflog: permission denied”
2023-12-12_20:52:31.06489 level=info ts=2023-12-12T20:52:31.064Z caller=main.go:216 msg=“Starting Alertmanager” version=“(version=0.21.0, branch=master, revision=)”
2023-12-12_20:52:31.06497 level=info ts=2023-12-12T20:52:31.064Z caller=main.go:217 build_context=“(go=go1.14.7, user=GitLab-Omnibus, date=)”
2023-12-12_20:52:31.06578 level=info ts=2023-12-12T20:52:31.065Z caller=cluster.go:161 component=cluster msg=“setting advertise address explicitly” addr=10.96.224.67 port=9094
2023-12-12_20:52:31.06676 level=error ts=2023-12-12T20:52:31.066Z caller=main.go:261 err=“open /var/opt/gitlab/alertmanager/data/nflog: permission denied”
==> /var/log/gitlab/prometheus/current <==
2023-12-12_20:52:31.17395 level=info ts=2023-12-12T20:52:31.171Z caller=main.go:589 msg=“Stopping scrape manager…”
2023-12-12_20:52:31.17395 level=info ts=2023-12-12T20:52:31.171Z caller=main.go:563 msg=“Notify discovery manager stopped”
2023-12-12_20:52:31.17396 level=info ts=2023-12-12T20:52:31.171Z caller=web.go:524 component=web msg=“Start listening for connections” address=localhost:9090
2023-12-12_20:52:31.17396 level=info ts=2023-12-12T20:52:31.173Z caller=main.go:549 msg=“Scrape discovery manager stopped”
2023-12-12_20:52:31.17396 level=info ts=2023-12-12T20:52:31.173Z caller=manager.go:888 component=“rule manager” msg=“Stopping rule manager…”
2023-12-12_20:52:31.17397 level=info ts=2023-12-12T20:52:31.173Z caller=manager.go:898 component=“rule manager” msg=“Rule manager stopped”
2023-12-12_20:52:31.17398 level=info ts=2023-12-12T20:52:31.173Z caller=notifier.go:601 component=notifier msg=“Stopping notification manager…”
2023-12-12_20:52:31.17399 level=info ts=2023-12-12T20:52:31.173Z caller=main.go:755 msg=“Notifier manager stopped”
2023-12-12_20:52:31.17400 level=info ts=2023-12-12T20:52:31.173Z caller=main.go:583 msg=“Scrape manager stopped”
2023-12-12_20:52:31.17400 level=error ts=2023-12-12T20:52:31.173Z caller=main.go:764 err=“opening storage failed: block dir: "/var/opt/gitlab/prometheus/data/01HFAT8PNMS3XD5GHRHH6P32Q9": open /var/opt/gitlab/prometheus/data/01HFAT8PNMS3XD5GHRHH6P32Q9/meta.json: permission denied”
==> /var/log/gitlab/grafana/current <==
2023-12-12_20:52:30.67827 t=2023-12-12T14:52:30-0600 lvl=info msg=“Config loaded from” logger=settings file=/var/opt/gitlab/grafana/grafana.ini
2023-12-12_20:52:30.67828 t=2023-12-12T14:52:30-0600 lvl=info msg=“Path Home” logger=settings path=/var/opt/gitlab/grafana
2023-12-12_20:52:30.67828 t=2023-12-12T14:52:30-0600 lvl=info msg=“Path Data” logger=settings path=/var/opt/gitlab/grafana/data
2023-12-12_20:52:30.67829 t=2023-12-12T14:52:30-0600 lvl=info msg=“Path Logs” logger=settings path=/var/log/gitlab/grafana
2023-12-12_20:52:30.67830 t=2023-12-12T14:52:30-0600 lvl=info msg=“Path Plugins” logger=settings path=/var/opt/gitlab/grafana/data/plugins
2023-12-12_20:52:30.67830 t=2023-12-12T14:52:30-0600 lvl=info msg=“Path Provisioning” logger=settings path=/var/opt/gitlab/grafana/provisioning
2023-12-12_20:52:30.67831 t=2023-12-12T14:52:30-0600 lvl=info msg=“App mode production” logger=settings
2023-12-12_20:52:30.67908 t=2023-12-12T14:52:30-0600 lvl=info msg=“Connecting to DB” logger=sqlstore dbtype=sqlite3
2023-12-12_20:52:30.67976 t=2023-12-12T14:52:30-0600 lvl=info msg=“Starting DB migration” logger=migrator
2023-12-12_20:52:30.68008 t=2023-12-12T14:52:30-0600 lvl=eror msg=“Server shutdown” logger=server reason=“Service init failed: Migration failed err: unable to open database file”
==> /var/log/gitlab/prometheus/current <==
2023-12-12_20:52:32.27016 level=info ts=2023-12-12T20:52:32.270Z caller=main.go:308 msg=“No time or size retention was set so using the default time retention” duration=15d
2023-12-12_20:52:32.27031 level=info ts=2023-12-12T20:52:32.270Z caller=main.go:343 msg=“Starting Prometheus” version=“(version=2.20.1, branch=master, revision=)”
2023-12-12_20:52:32.27040 level=info ts=2023-12-12T20:52:32.270Z caller=main.go:344 build_context=“(go=go1.14.7, user=GitLab-Omnibus, date=)”
2023-12-12_20:52:32.27049 level=info ts=2023-12-12T20:52:32.270Z caller=main.go:345 host_details=“(Linux 2.6.32-754.35.1.el6.x86_64 #1 SMP Sat Nov 7 12:42:14 UTC 2020 x86_64 old-rainier.pca.state.mn.us (none))”
2023-12-12_20:52:32.27058 level=info ts=2023-12-12T20:52:32.270Z caller=main.go:346 fd_limits=“(soft=50000, hard=50000)”
2023-12-12_20:52:32.27066 level=info ts=2023-12-12T20:52:32.270Z caller=main.go:347 vm_limits=“(soft=unlimited, hard=unlimited)”
2023-12-12_20:52:32.27494 level=info ts=2023-12-12T20:52:32.272Z caller=main.go:684 msg=“Starting TSDB …”
2023-12-12_20:52:32.27496 level=info ts=2023-12-12T20:52:32.272Z caller=main.go:553 msg=“Stopping scrape discovery manager…”
2023-12-12_20:52:32.27497 level=info ts=2023-12-12T20:52:32.272Z caller=main.go:567 msg=“Stopping notify discovery manager…”
2023-12-12_20:52:32.27497 level=info ts=2023-12-12T20:52:32.272Z caller=main.go:589 msg=“Stopping scrape manager…”
2023-12-12_20:52:32.27498 level=info ts=2023-12-12T20:52:32.272Z caller=main.go:563 msg=“Notify discovery manager stopped”
2023-12-12_20:52:32.27499 level=info ts=2023-12-12T20:52:32.273Z caller=web.go:524 component=web msg=“Start listening for connections” address=localhost:9090
2023-12-12_20:52:32.27499 level=info ts=2023-12-12T20:52:32.274Z caller=main.go:549 msg=“Scrape discovery manager stopped”
2023-12-12_20:52:32.27500 level=info ts=2023-12-12T20:52:32.274Z caller=manager.go:888 component=“rule manager” msg=“Stopping rule manager…”
2023-12-12_20:52:32.27500 level=info ts=2023-12-12T20:52:32.274Z caller=manager.go:898 component=“rule manager” msg=“Rule manager stopped”
2023-12-12_20:52:32.27500 level=info ts=2023-12-12T20:52:32.274Z caller=notifier.go:601 component=notifier msg=“Stopping notification manager…”
2023-12-12_20:52:32.27502 level=info ts=2023-12-12T20:52:32.274Z caller=main.go:755 msg=“Notifier manager stopped”
2023-12-12_20:52:32.27503 level=info ts=2023-12-12T20:52:32.274Z caller=main.go:583 msg=“Scrape manager stopped”
2023-12-12_20:52:32.27503 level=error ts=2023-12-12T20:52:32.274Z caller=main.go:764 err="opening storage failed: block dir: "/var/opt/gitlab/prometheus/data/01HFAT8PNMS3XD5GHRHH6P32Q9": open /var/opt/gitlab/prometheus/data/01HFAT8PNMS3XD5GHRHH6P32Q9/meta.json: permission denied
Any ideas what I am doing wrong?
–ja