Installation by helm

Hello,

I want to install Gitlab on Kubernetes, the problem is cannot mount rook-ceph stroage, below is my command and value.yaml file.

helm3 install gitlab gitlab/gitlab --namespace gitlab --timeout 600s --set certmanager.install=false --set global.hosts.domain=itclub.ltd --set global.hosts.externalIP=xxx.xxx.xx.xxx --set certmanager-issuer.email=user@example.com

gitlab:
gitaly:
persistence:
storageClass: rook-cephfs
size: 20Gi
postgresql:
persistence:
storageClass: rook-cephfs
size: 8Gi
minio:
persistence:
storageClass: rook-cephfs
size: 10Gi
prometheus:
persistence:
storageClass: rook-cephfs
size: 10Gi
redis:
master:
persistence:
storageClass: rook-cephfs
size: 5Gi

pvc and pv:
[root@sealos01 gitlab]# kubectl get pv -n gitlab
NAME CAPACITY ACCESS MODES RECLAIM POLICY STATUS CLAIM STORAGECLASS REASON AGE
pvc-28c6e784-a54c-4eb7-b5ea-8a268bc77668 10Gi RWO Retain Bound gitlab/gitlab-minio rook-cephfs 66m
pvc-b0f106dd-d840-43f6-9771-772a6d48c19f 20Gi RWO Retain Bound gitlab/repo-data-gitlab-gitaly-0 rook-cephfs 66m
pvc-b84c7dd3-7b45-4528-a5fa-dbf7784f1cf5 5Gi RWO Retain Bound gitlab/redis-data-gitlab-redis-master-0 rook-cephfs 66m
pvc-e3b03482-53c5-427c-89c6-6c2715b487a0 8Gi RWO Retain Bound gitlab/data-gitlab-postgresql-0 rook-cephfs 66m

[root@sealos01 gitlab]# kubectl get pvc -n gitlab
NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS AGE
data-gitlab-postgresql-0 Bound pvc-e3b03482-53c5-427c-89c6-6c2715b487a0 8Gi RWO rook-cephfs 66m
gitlab-minio Bound pvc-28c6e784-a54c-4eb7-b5ea-8a268bc77668 10Gi RWO rook-cephfs 66m
gitlab-prometheus-server Pending 66m
redis-data-gitlab-redis-master-0 Bound pvc-b84c7dd3-7b45-4528-a5fa-dbf7784f1cf5 5Gi RWO rook-cephfs 66m
repo-data-gitlab-gitaly-0 Bound pvc-b0f106dd-d840-43f6-9771-772a6d48c19f 20Gi RWO rook-cephfs 66m

Some Pods Init not finish or CrashLoopBackOff

Some events:

Events:
Type Reason Age From Message


Warning FailedMount 59m kubelet Unable to attach or mount volumes: unmounted volumes=[init-runner-secrets], unattached volumes=[configmaps init-runner-secrets kube-api-access-kptkq etc-gitlab-runner runner-secrets]: timed out waiting for the condition
Warning FailedMount 43m (x5 over 61m) kubelet Unable to attach or mount volumes: unmounted volumes=[init-runner-secrets], unattached volumes=[runner-secrets configmaps init-runner-secrets kube-api-access-kptkq etc-gitlab-runner]: timed out waiting for the condition
Warning FailedMount 27m (x6 over 57m) kubelet Unable to attach or mount volumes: unmounted volumes=[init-runner-secrets], unattached volumes=[kube-api-access-kptkq etc-gitlab-runner runner-secrets configmaps init-runner-secrets]: timed out waiting for the condition
Warning FailedMount 23m kubelet Unable to attach or mount volumes: unmounted volumes=[init-runner-secrets], unattached volumes=[init-runner-secrets kube-api-access-kptkq etc-gitlab-runner runner-secrets configmaps]: timed out waiting for the condition
Warning FailedMount 8m40s (x35 over 63m) kubelet MountVolume.SetUp failed for volume “init-runner-secrets” : secret “gitlab-gitlab-runner-secret” not found
Warning FailedMount 2m43s (x5 over 45m) kubelet Unable to attach or mount volumes: unmounted volumes=[init-runner-secrets], unattached volumes=[etc-gitlab-runner runner-secrets configmaps init-runner-secrets kube-api-access-kptkq]: timed out waiting for the condition


Events:
Type Reason Age From Message


Warning FailedMount 46m (x3 over 62m) kubelet Unable to attach or mount volumes: unmounted volumes=[init-migrations-secrets], unattached volumes=[init-migrations-secrets migrations-secrets etc-ssl-certs migrations-config]: timed out waiting for the condition
Warning FailedMount 28m (x2 over 44m) kubelet Unable to attach or mount volumes: unmounted volumes=[init-migrations-secrets], unattached volumes=[migrations-secrets etc-ssl-certs migrations-config init-migrations-secrets]: timed out waiting for the condition
Warning FailedMount 19m (x7 over 57m) kubelet Unable to attach or mount volumes: unmounted volumes=[init-migrations-secrets], unattached volumes=[etc-ssl-certs migrations-config init-migrations-secrets migrations-secrets]: timed out waiting for the condition
Warning FailedMount 9m30s (x35 over 64m) kubelet MountVolume.SetUp failed for volume “init-migrations-secrets” : secret “gitlab-gitlab-runner-secret” not found
Warning FailedMount 3m24s (x5 over 60m) kubelet Unable to attach or mount volumes: unmounted volumes=[init-migrations-secrets], unattached volumes=[migrations-config init-migrations-secrets migrations-secrets etc-ssl-certs]: timed out waiting for the condition


Events:
Type Reason Age From Message


Normal Created 57m (x4 over 60m) kubelet Created container dependencies
Normal Started 57m (x4 over 60m) kubelet Started container dependencies
Normal Pulled 15m (x12 over 59m) kubelet Container image “registry.gitlab.com/gitlab-org/build/cng/gitlab-sidekiq-ee:v14.8.1” already present on machine
Warning BackOff 5s (x227 over 58m) kubelet Back-off restarting failed container

Hello,

Any body can help?

Thanks

No one can help?

Hello, can someone help?

I’m not super knowledgeable on all of this but I would think it could be something related to the container config based on the secrets mount fails. I ran into something similar with their runners, and had to adjust some YAML options to allow the secrets to be accessible for that namespace. I would try hunting around those errors if I was having this issue. Sorry I couldn’t be of more help.

1 Like