Hi All,
I am trying to setup a local Gitlab deployment to learn and play about CI/CD
My initial goal: Trying to deploy and container based application (e.g. webserver) on my local k8s cluster and do some testing. In addition, would like to learn about other complementary tools like prometheus for monitoring my cluster
- Have deployed Gitlab-CE on Ubuntu 18.04 running on a virtual box
- Have microk8s cluster running kubernetes 1.17
- Managed integrate to the local k8s cluster
- Trying to install using the Gitlab managed apps
I get the famous error “permission denied”. Fortunate (or unfortunate), I see lot of materials on how/where to fix the permission using various methods - initContainers etc…
Unfortunately, I am struggling to connect the dots on where I can inject the initContainer to modify the mount permission. I am struggling to understand where does the actual prometheus deployment & values yaml files are stored which I can modify.
Apologies for my ignorance as I am trying this for first time, Here is the session log when I tried to install prometheus using Gitlab GUI
kubectl logs -f --namespace gitlab-managed-apps install-prometheus
- export ‘HELM_HOST=localhost:44134’
- helm init --client-only
- tiller -listen localhost:44134 -alsologtostderr
Creating /root/.helm
Creating /root/.helm/repository
Creating /root/.helm/repository/cache
Creating /root/.helm/repository/local
Creating /root/.helm/plugins
Creating /root/.helm/starters
Creating /root/.helm/cache/archive
Creating /root/.helm/repository/repositories.yaml
Adding stable repo with URL: https://kubernetes-charts.storage.googleapis.com
[main] 2020/11/10 11:14:44 Starting Tiller v2.16.9 (tls=false)
[main] 2020/11/10 11:14:44 GRPC listening on localhost:44134
[main] 2020/11/10 11:14:44 Probes listening on :44135
[main] 2020/11/10 11:14:44 Storage driver is ConfigMap
[main] 2020/11/10 11:14:44 Max history per release is 0
Adding local repo with URL: http://127.0.0.1:8879/charts
$HELM_HOME has been configured at /root/.helm.
Not installing Tiller due to ‘client-only’ flag having been set - helm repo add prometheus https://gitlab-org.gitlab.io/cluster-integration/helm-stable-archive
“prometheus” has been added to your repositories - helm repo update
Hang tight while we grab the latest from your chart repositories…
…Skip local chart repository
…Successfully got an update from the “prometheus” chart repository
…Successfully got an update from the “stable” chart repository
Update Complete. - helm upgrade prometheus prometheus/prometheus --install --atomic --cleanup-on-fail --reset-values --version 10.4.1 --set ‘rbac.create=false,rbac.enabled=false’ --namespace gitlab-managed-apps -f /data/helm/prometheus/config/values.yaml
[tiller] 2020/11/10 11:15:01 getting history for release prometheus
[storage] 2020/11/10 11:15:01 getting release history for “prometheus”
Release “prometheus” does not exist. Installing it now.
[tiller] 2020/11/10 11:15:01 preparing install for prometheus
[storage] 2020/11/10 11:15:01 getting release history for “prometheus”
[tiller] 2020/11/10 11:15:01 rendering prometheus chart using values
2020/11/10 11:15:01 info: manifest “prometheus/templates/kube-state-metrics-clusterrolebinding.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/server-clusterrolebinding.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/pushgateway-networkpolicy.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/node-exporter-podsecuritypolicy.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/alertmanager-service.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/pushgateway-clusterrolebinding.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/node-exporter-rolebinding.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/kube-state-metrics-networkpolicy.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/pushgateway-service.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/node-exporter-service.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/server-vpa.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/pushgateway-ingress.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/node-exporter-role.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/server-clusterrole.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/pushgateway-serviceaccount.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/pushgateway-deployment.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/alertmanager-deployment.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/alertmanager-configmap.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/pushgateway-pvc.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/kube-state-metrics-clusterrole.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/server-service-headless.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/pushgateway-podsecuritypolicy.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/pushgateway-pdb.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/kube-state-metrics-pdb.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/alertmanager-podsecuritypolicy.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/node-exporter-serviceaccount.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/node-exporter-daemonset.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/kube-state-metrics-podsecuritypolicy.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/alertmanager-ingress.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/alertmanager-statefulset.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/alertmanager-serviceaccount.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/alertmanager-service-headless.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/alertmanager-pvc.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/alertmanager-clusterrolebinding.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/pushgateway-clusterrole.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/alertmanager-networkpolicy.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/alertmanager-pdb.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/alertmanager-clusterrole.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/server-statefulset.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/server-podsecuritypolicy.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/server-pdb.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/server-ingress.yaml” is empty. Skipping.
2020/11/10 11:15:01 info: manifest “prometheus/templates/server-networkpolicy.yaml” is empty. Skipping.
[tiller] 2020/11/10 11:15:01 performing install for prometheus
[tiller] 2020/11/10 11:15:01 executing 0 crd-install hooks for prometheus
[tiller] 2020/11/10 11:15:01 hooks complete for crd-install prometheus
[tiller] 2020/11/10 11:15:01 executing 0 pre-install hooks for prometheus
[tiller] 2020/11/10 11:15:01 hooks complete for pre-install prometheus
[storage] 2020/11/10 11:15:01 getting release history for “prometheus”
[storage] 2020/11/10 11:15:01 creating release “prometheus.v1”
[kube] 2020/11/10 11:15:01 building resources from manifest
[kube] 2020/11/10 11:15:01 creating 8 resource(s)
[kube] 2020/11/10 11:15:01 beginning wait for 8 resources with timeout of 5m0s
[kube] 2020/11/10 11:15:04 Deployment is not ready: gitlab-managed-apps/prometheus-kube-state-metrics
[kube] 2020/11/10 11:15:06 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:08 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:10 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:12 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:14 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:16 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:18 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:20 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:22 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:24 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:26 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:28 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:30 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:32 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:34 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:36 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:38 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:40 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:42 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:44 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:46 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:48 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:50 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:52 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:54 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:56 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:15:58 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:00 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:02 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:04 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:06 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:08 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:10 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:12 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:14 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:16 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:18 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:20 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:22 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:24 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:26 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:28 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:30 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:32 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:34 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:36 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:38 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:40 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:42 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:44 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:46 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:48 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:50 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:52 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:54 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:56 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:16:58 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:00 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:02 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:04 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:06 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:08 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:10 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:12 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:14 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:16 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:18 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:20 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:22 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:24 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:26 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:28 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:30 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:32 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:34 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:36 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:38 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:40 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:42 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:44 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:46 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:48 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:50 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:52 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:54 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:56 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:17:58 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:00 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:02 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:04 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:06 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:08 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:10 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:12 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:14 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:16 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:18 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:20 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:22 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:24 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:26 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:28 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:30 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:32 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:34 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:36 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:38 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:40 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:42 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:44 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:46 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:48 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:50 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:52 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:54 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:56 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:18:58 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:00 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:02 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:04 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:06 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:08 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:10 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:12 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:14 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:16 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:18 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:20 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:22 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:24 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:26 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:28 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:30 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:32 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:34 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:36 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:38 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:40 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:42 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:44 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:46 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:48 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:50 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:52 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:54 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:56 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:19:58 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:20:00 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:20:02 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[kube] 2020/11/10 11:20:02 Deployment is not ready: gitlab-managed-apps/prometheus-prometheus-server
[tiller] 2020/11/10 11:20:02 warning: Release “prometheus” failed: timed out waiting for the condition
[storage] 2020/11/10 11:20:02 updating release “prometheus.v1”
[tiller] 2020/11/10 11:20:02 failed install perform step: release prometheus failed: timed out waiting for the condition
INSTALL FAILED
PURGING CHART
Error: release prometheus failed: timed out waiting for the condition
[storage] 2020/11/10 11:20:02 getting release history for “prometheus”
[tiller] 2020/11/10 11:20:02 uninstall: Deleting prometheus
[tiller] 2020/11/10 11:20:02 executing 0 pre-delete hooks for prometheus
[tiller] 2020/11/10 11:20:02 hooks complete for pre-delete prometheus
[storage] 2020/11/10 11:20:02 updating release “prometheus.v1”
[kube] 2020/11/10 11:20:02 Starting delete for “prometheus-kube-state-metrics” Service
[kube] 2020/11/10 11:20:02 Starting delete for “prometheus-prometheus-server” Service
[kube] 2020/11/10 11:20:02 Starting delete for “prometheus-kube-state-metrics” Deployment
[kube] 2020/11/10 11:20:02 Starting delete for “prometheus-prometheus-server” Deployment
[kube] 2020/11/10 11:20:02 Starting delete for “prometheus-kube-state-metrics” ServiceAccount
[kube] 2020/11/10 11:20:02 Starting delete for “prometheus-prometheus-server” ServiceAccount
[kube] 2020/11/10 11:20:02 Starting delete for “prometheus-prometheus-server” PersistentVolumeClaim
[kube] 2020/11/10 11:20:02 Starting delete for “prometheus-prometheus-server” ConfigMap
[tiller] 2020/11/10 11:20:02 executing 0 post-delete hooks for prometheus
[tiller] 2020/11/10 11:20:02 hooks complete for post-delete prometheus
[tiller] 2020/11/10 11:20:02 purge requested for prometheus
[storage] 2020/11/10 11:20:02 deleting release “prometheus.v1”
Successfully purged a chart!
Error: release prometheus failed: timed out waiting for the condition
====
kubectl -n gitlab-managed-apps logs kubectl -n gitlab-managed-apps get pods | tail -1 | awk '{print $1}' -c prometheus-server
level=info ts=2020-11-10T11:15:36.970Z caller=main.go:330 msg=“Starting Prometheus” version="(version=2.15.2, branch=HEAD, revision=d9613e5c466c6e9de548c4dae1b9aabf9aaf7c57)"
level=info ts=2020-11-10T11:15:36.970Z caller=main.go:331 build_context="(go=go1.13.5, user=root@688433cf4ff7, date=20200106-14:50:51)"
level=info ts=2020-11-10T11:15:36.970Z caller=main.go:332 host_details="(Linux 5.4.0-52-generic #57~18.04.1-Ubuntu SMP Thu Oct 15 14:04:49 UTC 2020 x86_64 prometheus-prometheus-server-59596d7f4-f49lw (none))"
level=info ts=2020-11-10T11:15:36.970Z caller=main.go:333 fd_limits="(soft=65536, hard=65536)"
level=info ts=2020-11-10T11:15:36.970Z caller=main.go:334 vm_limits="(soft=unlimited, hard=unlimited)"
level=error ts=2020-11-10T11:15:36.970Z caller=query_logger.go:85 component=activeQueryTracker msg=“Error opening query log file” file=/data/queries.active err=“open /data/queries.active: permission denied”
panic: Unable to create mmap-ed active query log
goroutine 1 [running]:
github.com/prometheus/prometheus/promql.NewActiveQueryTracker(0x7ffe90884c07, 0x5, 0x14, 0x2c635a0, 0xc0006334d0, 0x2c635a0)
/app/promql/query_logger.go:115 +0x48c
main.main()
/app/cmd/prometheus/main.go:362 +0x5229