Hi Everyone,
I’ve installed a fresh CentOS 7 (kernel: 3.10.0-862.14.4.el7.x86_64), I’ve configured the repository storage to point to a network RAID device, which I’ve mounted to /mnt/nfs/.
Since I’ve updated the storage to that directory I’m always getting either 503 or 500 error after pressing the green Create project button.
When executing gitlab-ctl tail, I get the following:
==> /var/log/gitlab/node-exporter/state <==
==> /var/log/gitlab/node-exporter/current <==
==> /var/log/gitlab/redis-exporter/state <==
==> /var/log/gitlab/redis-exporter/current <==
==> /var/log/gitlab/gitlab-monitor/state <==
==> /var/log/gitlab/gitlab-monitor/current <==
2018-10-24_13:12:22.51856 ::1 - - [24/Oct/2018:16:12:22 IDT] “GET /sidekiq HTTP/1.1” 200 20972
2018-10-24_13:12:22.51858 - -> /sidekiq
2018-10-24_13:12:24.42080 ::1 - - [24/Oct/2018:16:12:24 IDT] “GET /database HTTP/1.1” 200 89407
2018-10-24_13:12:24.42082 - -> /database
2018-10-24_13:12:26.68424 ::1 - - [24/Oct/2018:16:12:26 IDT] “GET /process HTTP/1.1” 200 3645
2018-10-24_13:12:26.68425 - -> /process
2018-10-24_13:12:37.47386 ::1 - - [24/Oct/2018:16:12:37 IDT] “GET /sidekiq HTTP/1.1” 200 20972
2018-10-24_13:12:37.47388 - -> /sidekiq
2018-10-24_13:12:39.41657 ::1 - - [24/Oct/2018:16:12:39 IDT] “GET /database HTTP/1.1” 200 89407
2018-10-24_13:12:39.41658 - -> /database
==> /var/log/gitlab/gitlab-workhorse/state <==
==> /var/log/gitlab/gitlab-workhorse/current <==
==> /var/log/gitlab/unicorn/unicorn_stderr.log <==
I, [2018-10-24T05:56:18.719682 #2438] INFO – : reaped #<Process::Status: pid 4447 exit 0> worker=1
I, [2018-10-24T05:56:18.798324 #15237] INFO – : worker=1 ready
W, [2018-10-24T15:21:18.716962 #3229] WARN – : #Unicorn::HttpServer:0x00007f8609dbb370: worker (pid: 3229) exceeds memory limit (509062144.0 bytes > 506077174 bytes)
W, [2018-10-24T15:21:18.717037 #3229] WARN – : Unicorn::WorkerKiller send SIGQUIT (pid: 3229) alive: 84990 sec (trial 1)
I, [2018-10-24T15:21:18.811041 #2438] INFO – : reaped #<Process::Status: pid 3229 exit 0> worker=5
I, [2018-10-24T15:21:18.889120 #31008] INFO – : worker=5 ready
W, [2018-10-24T15:59:33.733706 #31008] WARN – : #Unicorn::HttpServer:0x00007f8609dbb370: worker (pid: 31008) exceeds memory limit (489646080.0 bytes > 457067027 bytes)
W, [2018-10-24T15:59:33.733745 #31008] WARN – : Unicorn::WorkerKiller send SIGQUIT (pid: 31008) alive: 2250 sec (trial 1)
I, [2018-10-24T15:59:33.757112 #2438] INFO – : reaped #<Process::Status: pid 31008 exit 0> worker=5
I, [2018-10-24T15:59:33.845421 #4688] INFO – : worker=5 ready
==> /var/log/gitlab/unicorn/unicorn_stdout.log <==
==> /var/log/gitlab/unicorn/state <==
==> /var/log/gitlab/unicorn/current <==
==> /var/log/gitlab/gitaly/state <==
==> /var/log/gitlab/gitaly/current <==
==> /var/log/gitlab/prometheus/state <==
==> /var/log/gitlab/prometheus/current <==
2018-10-24_12:49:26.96014 time=“2018-10-24T15:49:26+03:00” level=info msg=“Checkpointing in-memory metrics and chunks…” source=“persistence.go:633”
2018-10-24_12:49:27.03311 time=“2018-10-24T15:49:27+03:00” level=info msg=“Done checkpointing in-memory metrics and chunks in 72.934927ms.” source=“persistence.go:665”
2018-10-24_12:54:27.03372 time=“2018-10-24T15:54:27+03:00” level=info msg=“Checkpointing in-memory metrics and chunks…” source=“persistence.go:633”
2018-10-24_12:54:27.18217 time=“2018-10-24T15:54:27+03:00” level=info msg=“Done checkpointing in-memory metrics and chunks in 148.472169ms.” source=“persistence.go:665”
2018-10-24_12:59:27.18248 time=“2018-10-24T15:59:27+03:00” level=info msg=“Checkpointing in-memory metrics and chunks…” source=“persistence.go:633”
2018-10-24_12:59:27.29292 time=“2018-10-24T15:59:27+03:00” level=info msg=“Done checkpointing in-memory metrics and chunks in 110.419439ms.” source=“persistence.go:665”
2018-10-24_13:04:27.29309 time=“2018-10-24T16:04:27+03:00” level=info msg=“Checkpointing in-memory metrics and chunks…” source=“persistence.go:633”
2018-10-24_13:04:27.36522 time=“2018-10-24T16:04:27+03:00” level=info msg=“Done checkpointing in-memory metrics and chunks in 72.00881ms.” source=“persistence.go:665”
2018-10-24_13:09:27.36563 time=“2018-10-24T16:09:27+03:00” level=info msg=“Checkpointing in-memory metrics and chunks…” source=“persistence.go:633”
2018-10-24_13:09:27.50675 time=“2018-10-24T16:09:27+03:00” level=info msg=“Done checkpointing in-memory metrics and chunks in 141.082259ms.” source=“persistence.go:665”
==> /var/log/gitlab/postgresql/state <==
==> /var/log/gitlab/postgresql/current <==
==> /var/log/gitlab/postgres-exporter/state <==
==> /var/log/gitlab/postgres-exporter/current <==
==> /var/log/gitlab/gitlab-shell/gitlab-shell.log <==
==> /var/log/gitlab/gitlab-rails/production_json.log <==
{“method”:“GET”,“path”:"/-/metrics",“format”:“html”,“controller”:“MetricsController”,“action”:“index”,“status”:200,“duration”:2.68,“view”:0.15,“db”:0.0,“time”:“2018-10-24T13:10:18.687Z”,“params”:,“remote_ip”:null,“user_id”:null,“username”:null,“ua”:null}
{“method”:“GET”,“path”:"/-/metrics",“format”:“html”,“controller”:“MetricsController”,“action”:“index”,“status”:200,“duration”:12.13,“view”:0.55,“db”:0.0,“time”:“2018-10-24T13:10:33.676Z”,“params”:,“remote_ip”:null,“user_id”:null,“username”:null,“ua”:null}
{“method”:“GET”,“path”:"/-/metrics",“format”:“html”,“controller”:“MetricsController”,“action”:“index”,“status”:200,“duration”:12.04,“view”:0.56,“db”:0.0,“time”:“2018-10-24T13:10:48.676Z”,“params”:,“remote_ip”:null,“user_id”:null,“username”:null,“ua”:null}
{“method”:“GET”,“path”:"/-/metrics",“format”:“html”,“controller”:“MetricsController”,“action”:“index”,“status”:200,“duration”:2.61,“view”:0.15,“db”:0.0,“time”:“2018-10-24T13:11:03.675Z”,“params”:,“remote_ip”:null,“user_id”:null,“username”:null,“ua”:null}
{“method”:“GET”,“path”:"/-/metrics",“format”:“html”,“controller”:“MetricsController”,“action”:“index”,“status”:200,“duration”:7.48,“view”:0.4,“db”:0.0,“time”:“2018-10-24T13:11:18.672Z”,“params”:,“remote_ip”:null,“user_id”:null,“username”:null,“ua”:null}
{“method”:“GET”,“path”:"/-/metrics",“format”:“html”,“controller”:“MetricsController”,“action”:“index”,“status”:200,“duration”:2.69,“view”:0.16,“db”:0.0,“time”:“2018-10-24T13:11:33.694Z”,“params”:,“remote_ip”:null,“user_id”:null,“username”:null,“ua”:null}
{“method”:“GET”,“path”:"/-/metrics",“format”:“html”,“controller”:“MetricsController”,“action”:“index”,“status”:200,“duration”:2.63,“view”:0.14,“db”:0.0,“time”:“2018-10-24T13:11:48.675Z”,“params”:,“remote_ip”:null,“user_id”:null,“username”:null,“ua”:null}
{“method”:“GET”,“path”:"/-/metrics",“format”:“html”,“controller”:“MetricsController”,“action”:“index”,“status”:200,“duration”:3.66,“view”:0.15,“db”:0.0,“time”:“2018-10-24T13:12:03.672Z”,“params”:,“remote_ip”:null,“user_id”:null,“username”:null,“ua”:null}
{“method”:“GET”,“path”:"/-/metrics",“format”:“html”,“controller”:“MetricsController”,“action”:“index”,“status”:200,“duration”:2.78,“view”:0.18,“db”:0.0,“time”:“2018-10-24T13:12:18.670Z”,“params”:,“remote_ip”:null,“user_id”:null,“username”:null,“ua”:null}
{“method”:“GET”,“path”:"/-/metrics",“format”:“html”,“controller”:“MetricsController”,“action”:“index”,“status”:200,“duration”:12.15,“view”:0.57,“db”:0.0,“time”:“2018-10-24T13:12:33.676Z”,“params”:,“remote_ip”:null,“user_id”:null,“username”:null,“ua”:null}
==> /var/log/gitlab/gitlab-rails/grpc.log <==
==> /var/log/gitlab/gitlab-rails/sidekiq.log <==
2018-10-24_13:10:02.23857 2018-10-24T13:10:02.238Z 2087 TID-oqxpsbblf UpdateAllMirrorsWorker JID-6c52550bb2604ead709d9542 INFO: done: 0.043 sec
2018-10-24_13:10:02.24041 2018-10-24T13:10:02.240Z 2087 TID-oqxpsb6p3 Geo::SidekiqCronConfigWorker JID-86cb0bb996c5335a48a34603 INFO: done: 0.023 sec
2018-10-24_13:11:16.00591 2018-10-24T13:11:16.005Z 2087 TID-oqxpsbaev UpdateAllMirrorsWorker JID-83bdee71d9bfee284e1ad690 INFO: start
2018-10-24_13:11:16.02730 2018-10-24T13:11:16.027Z 2087 TID-oqxpsba5b Geo::SidekiqCronConfigWorker JID-15f05da053eda1481b53faa2 INFO: start
2018-10-24_13:11:16.04478 2018-10-24T13:11:16.044Z 2087 TID-oqxpsbaev UpdateAllMirrorsWorker JID-83bdee71d9bfee284e1ad690 INFO: done: 0.039 sec
2018-10-24_13:11:16.05116 2018-10-24T13:11:16.051Z 2087 TID-oqxpsba5b Geo::SidekiqCronConfigWorker JID-15f05da053eda1481b53faa2 INFO: done: 0.024 sec
2018-10-24_13:12:33.98954 2018-10-24T13:12:33.989Z 2087 TID-oqxpsb6p3 UpdateAllMirrorsWorker JID-5c429a55b617667107e505f4 INFO: start
2018-10-24_13:12:34.01283 2018-10-24T13:12:34.012Z 2087 TID-oqxpsb6cv Geo::SidekiqCronConfigWorker JID-97ec2e219e0fbbc2bd19aa43 INFO: start
2018-10-24_13:12:34.05191 2018-10-24T13:12:34.051Z 2087 TID-oqxpsb6p3 UpdateAllMirrorsWorker JID-5c429a55b617667107e505f4 INFO: done: 0.062 sec
2018-10-24_13:12:34.05255 2018-10-24T13:12:34.052Z 2087 TID-oqxpsb6cv Geo::SidekiqCronConfigWorker JID-97ec2e219e0fbbc2bd19aa43 INFO: done: 0.04 sec
==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2018-10-16-16-44-28.log <==
==> /var/log/gitlab/gitlab-rails/production.log <==
Completed 200 OK in 2ms (Views: 0.1ms | ActiveRecord: 0.0ms | Elasticsearch: 0.0ms)
Started GET “/-/metrics” for 127.0.0.1 at 2018-10-24 16:12:03 +0300
Processing by MetricsController#index as HTML
Completed 200 OK in 3ms (Views: 0.2ms | ActiveRecord: 0.0ms | Elasticsearch: 0.0ms)
Started GET “/-/metrics” for 127.0.0.1 at 2018-10-24 16:12:18 +0300
Processing by MetricsController#index as HTML
Completed 200 OK in 2ms (Views: 0.2ms | ActiveRecord: 0.0ms | Elasticsearch: 0.0ms)
Started GET “/-/metrics” for 127.0.0.1 at 2018-10-24 16:12:33 +0300
Processing by MetricsController#index as HTML
Completed 200 OK in 10ms (Views: 0.6ms | ActiveRecord: 0.0ms | Elasticsearch: 0.0ms)
==> /var/log/gitlab/gitlab-rails/sidekiq_exporter.log <==
[2018-10-24 16:10:14] 127.0.0.1 - - [24/Oct/2018:16:10:14 IDT] “GET /metrics HTTP/1.1” 200 5173 “-” “Prometheus/1.8.2”
[2018-10-24 16:10:29] 127.0.0.1 - - [24/Oct/2018:16:10:29 IDT] “GET /metrics HTTP/1.1” 200 5173 “-” “Prometheus/1.8.2”
[2018-10-24 16:10:44] 127.0.0.1 - - [24/Oct/2018:16:10:44 IDT] “GET /metrics HTTP/1.1” 200 5175 “-” “Prometheus/1.8.2”
[2018-10-24 16:10:59] 127.0.0.1 - - [24/Oct/2018:16:10:59 IDT] “GET /metrics HTTP/1.1” 200 5175 “-” “Prometheus/1.8.2”
[2018-10-24 16:11:14] 127.0.0.1 - - [24/Oct/2018:16:11:14 IDT] “GET /metrics HTTP/1.1” 200 5175 “-” “Prometheus/1.8.2”
[2018-10-24 16:11:29] 127.0.0.1 - - [24/Oct/2018:16:11:29 IDT] “GET /metrics HTTP/1.1” 200 5176 “-” “Prometheus/1.8.2”
[2018-10-24 16:11:44] 127.0.0.1 - - [24/Oct/2018:16:11:44 IDT] “GET /metrics HTTP/1.1” 200 5176 “-” “Prometheus/1.8.2”
[2018-10-24 16:11:59] 127.0.0.1 - - [24/Oct/2018:16:11:59 IDT] “GET /metrics HTTP/1.1” 200 5172 “-” “Prometheus/1.8.2”
[2018-10-24 16:12:14] 127.0.0.1 - - [24/Oct/2018:16:12:14 IDT] “GET /metrics HTTP/1.1” 200 5172 “-” “Prometheus/1.8.2”
[2018-10-24 16:12:29] 127.0.0.1 - - [24/Oct/2018:16:12:29 IDT] “GET /metrics HTTP/1.1” 200 5172 “-” “Prometheus/1.8.2”
==> /var/log/gitlab/gitlab-rails/api_json.log <==
==> /var/log/gitlab/gitlab-rails/application.log <==
==> /var/log/gitlab/logrotate/current <==
==> /var/log/gitlab/redis/state <==
==> /var/log/gitlab/redis/current <==
2018-10-24_13:03:38.00480 2072:M 24 Oct 16:03:38.004 * 10 changes in 300 seconds. Saving…
2018-10-24_13:03:38.00544 2072:M 24 Oct 16:03:38.005 * Background saving started by pid 5542
2018-10-24_13:03:38.01635 5542:C 24 Oct 16:03:38.016 * DB saved on disk
2018-10-24_13:03:38.01691 5542:C 24 Oct 16:03:38.016 * RDB: 5 MB of memory used by copy-on-write
2018-10-24_13:03:38.10575 2072:M 24 Oct 16:03:38.105 * Background saving terminated with success
2018-10-24_13:08:39.08113 2072:M 24 Oct 16:08:39.081 * 10 changes in 300 seconds. Saving…
2018-10-24_13:08:39.08172 2072:M 24 Oct 16:08:39.081 * Background saving started by pid 6441
2018-10-24_13:08:39.09217 6441:C 24 Oct 16:08:39.092 * DB saved on disk
2018-10-24_13:08:39.09270 6441:C 24 Oct 16:08:39.092 * RDB: 4 MB of memory used by copy-on-write
2018-10-24_13:08:39.18193 2072:M 24 Oct 16:08:39.181 * Background saving terminated with success
==> /var/log/gitlab/nginx/gitlab_access.log <==
192.168.0.9 - - [24/Oct/2018:15:19:43 +0300] “POST /projects HTTP/1.1” 503 2930 “http://gitlab.netio.cloud/projects/new” “Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Firefox/60.0”
192.168.0.9 - - [24/Oct/2018:15:20:28 +0300] “POST /projects HTTP/1.1” 500 2926 “http://gitlab.netio.cloud/projects/new” “Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Firefox/60.0”
192.168.0.9 - - [24/Oct/2018:15:38:02 +0300] “POST /projects HTTP/1.1” 503 2930 “http://gitlab.netio.cloud/projects/new” “Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Firefox/60.0”
==> /var/log/gitlab/nginx/gitlab_error.log <==
==> /var/log/gitlab/nginx/access.log <==
==> /var/log/gitlab/nginx/error.log <==
==> /var/log/gitlab/nginx/current <==
==> /var/log/gitlab/sidekiq/state <==
==> /var/log/gitlab/sidekiq/current <==
2018-10-24_13:10:02.23857 2018-10-24T13:10:02.238Z 2087 TID-oqxpsbblf UpdateAllMirrorsWorker JID-6c52550bb2604ead709d9542 INFO: done: 0.043 sec
2018-10-24_13:10:02.24041 2018-10-24T13:10:02.240Z 2087 TID-oqxpsb6p3 Geo::SidekiqCronConfigWorker JID-86cb0bb996c5335a48a34603 INFO: done: 0.023 sec
2018-10-24_13:11:16.00591 2018-10-24T13:11:16.005Z 2087 TID-oqxpsbaev UpdateAllMirrorsWorker JID-83bdee71d9bfee284e1ad690 INFO: start
2018-10-24_13:11:16.02730 2018-10-24T13:11:16.027Z 2087 TID-oqxpsba5b Geo::SidekiqCronConfigWorker JID-15f05da053eda1481b53faa2 INFO: start
2018-10-24_13:11:16.04478 2018-10-24T13:11:16.044Z 2087 TID-oqxpsbaev UpdateAllMirrorsWorker JID-83bdee71d9bfee284e1ad690 INFO: done: 0.039 sec
2018-10-24_13:11:16.05116 2018-10-24T13:11:16.051Z 2087 TID-oqxpsba5b Geo::SidekiqCronConfigWorker JID-15f05da053eda1481b53faa2 INFO: done: 0.024 sec
2018-10-24_13:12:33.98954 2018-10-24T13:12:33.989Z 2087 TID-oqxpsb6p3 UpdateAllMirrorsWorker JID-5c429a55b617667107e505f4 INFO: start
2018-10-24_13:12:34.01283 2018-10-24T13:12:34.012Z 2087 TID-oqxpsb6cv Geo::SidekiqCronConfigWorker JID-97ec2e219e0fbbc2bd19aa43 INFO: start
2018-10-24_13:12:34.05191 2018-10-24T13:12:34.051Z 2087 TID-oqxpsb6p3 UpdateAllMirrorsWorker JID-5c429a55b617667107e505f4 INFO: done: 0.062 sec
2018-10-24_13:12:34.05255 2018-10-24T13:12:34.052Z 2087 TID-oqxpsb6cv Geo::SidekiqCronConfigWorker JID-97ec2e219e0fbbc2bd19aa43 INFO: done: 0.04 sec
==> /var/log/gitlab/alertmanager/state <==
==> /var/log/gitlab/alertmanager/current <==
==> /var/log/gitlab/gitlab-workhorse/current <==
2018-10-24_13:12:40.84800 gitlab.netio.cloud @ - - [2018/10/24:16:12:40 +0300] “POST /projects HTTP/1.1” 503 2930 “http://gitlab.netio.cloud/projects/new” “Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Firefox/60.0” 0.582
==> /var/log/gitlab/gitlab-rails/production_json.log <==
{“method”:“POST”,“path”:"/projects",“format”:“html”,“controller”:“ProjectsController”,“action”:“create”,“status”:503,“duration”:566.71,“view”:8.67,“db”:28.43,“time”:“2018-10-24T13:12:40.279Z”,“params”:[{“key”:“utf8”,“value”:"\u2713"},{“key”:“authenticity_token”,“value”:"[FILTERED]"},{“key”:“project”,“value”:{“ci_cd_only”:“false”,“name”:“1822”,“namespace_id”:“1”,“path”:“1822”,“description”:"",“visibility_level”:“0”}}],“remote_ip”:“192.168.0.9”,“user_id”:1,“username”:“root”,“ua”:“Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Firefox/60.0”,“gitaly_calls”:2}
==> /var/log/gitlab/gitlab-rails/production.log <==
Started POST “/projects” for 192.168.0.9 at 2018-10-24 16:12:40 +0300
Processing by ProjectsController#create as HTML
Parameters: {“utf8”=>"\u2713", “authenticity_token”=>"[FILTERED]", “project”=>{“ci_cd_only”=>“false”, “name”=>“1822”, “namespace_id”=>“1”, “path”=>“1822”, “description”=>"", “visibility_level”=>“0”}}
Unable to save project. Error: 14:Connect Failed
GRPC::Unavailable (14:Connect Failed):
lib/gitlab/gitaly_client.rb:134:in call' lib/gitlab/gitaly_client/ref_service.rb:40:in default_branch_name’
lib/gitlab/git/repository.rb:108:in root_ref' app/models/repository.rb:512:in root_ref’
lib/gitlab/metrics/instrumentation.rb:159:in block in _uncached_root_ref' lib/gitlab/metrics/method_call.rb:34:in measure’
lib/gitlab/metrics/instrumentation.rb:159:in _uncached_root_ref' lib/gitlab/repository_cache_adapter.rb:17:in block (2 levels) in cache_method’
lib/gitlab/repository_cache.rb:22:in fetch' lib/gitlab/repository_cache_adapter.rb:59:in cache_method_output’
lib/gitlab/repository_cache_adapter.rb:16:in block in cache_method' lib/gitlab/metrics/instrumentation.rb:159:in block in root_ref’
lib/gitlab/metrics/method_call.rb:34:in measure' lib/gitlab/metrics/instrumentation.rb:159:in root_ref’
app/models/repository.rb:647:in head_commit' lib/gitlab/metrics/instrumentation.rb:159:in block in head_commit’
lib/gitlab/metrics/method_call.rb:34:in measure' lib/gitlab/metrics/instrumentation.rb:159:in head_commit’
app/models/repository.rb:658:in tree' lib/gitlab/metrics/instrumentation.rb:159:in block in tree’
lib/gitlab/metrics/method_call.rb:34:in measure' lib/gitlab/metrics/instrumentation.rb:159:in tree’
app/models/repository.rb:967:in file_on_head' lib/gitlab/metrics/instrumentation.rb:159:in block in file_on_head’
lib/gitlab/metrics/method_call.rb:34:in measure' lib/gitlab/metrics/instrumentation.rb:159:in file_on_head’
app/models/repository.rb:564:in block in avatar' lib/gitlab/gitaly_client.rb:333:in allow_n_plus_1_calls’
app/models/repository.rb:563:in avatar' lib/gitlab/metrics/instrumentation.rb:159:in block in _uncached_avatar’
lib/gitlab/metrics/method_call.rb:34:in measure' lib/gitlab/metrics/instrumentation.rb:159:in _uncached_avatar’
lib/gitlab/repository_cache_adapter.rb:17:in block (2 levels) in cache_method' lib/gitlab/repository_cache.rb:22:in fetch’
lib/gitlab/repository_cache_adapter.rb:59:in cache_method_output' lib/gitlab/repository_cache_adapter.rb:16:in block in cache_method’
lib/gitlab/metrics/instrumentation.rb:159:in block in avatar' lib/gitlab/metrics/method_call.rb:34:in measure’
lib/gitlab/metrics/instrumentation.rb:159:in avatar' app/models/project.rb:1165:in avatar_in_git’
app/models/project.rb:1169:in avatar_url' app/models/concerns/avatarable.rb:24:in avatar_url’
app/helpers/page_layout_helper.rb:50:in page_image' app/views/layouts/_head.html.haml:18:in _app_views_layouts__head_html_haml__1392463906424545365_70106536480780’
app/views/layouts/application.html.haml:3:in _app_views_layouts_application_html_haml___336512349038175745_70106519567720' app/controllers/projects_controller.rb:54:in create’
lib/gitlab/i18n.rb:53:in with_locale' lib/gitlab/i18n.rb:59:in with_user_locale’
app/controllers/application_controller.rb:411:in set_locale' lib/gitlab/middleware/multipart.rb:101:in call’
lib/gitlab/request_profiler/middleware.rb:14:in call' ee/lib/gitlab/jira/middleware.rb:15:in call’
lib/gitlab/middleware/go.rb:17:in call' lib/gitlab/etag_caching/middleware.rb:11:in call’
lib/gitlab/middleware/rails_queue_duration.rb:22:in call' lib/gitlab/metrics/rack_middleware.rb:15:in block in call’
lib/gitlab/metrics/transaction.rb:53:in run' lib/gitlab/metrics/rack_middleware.rb:15:in call’
lib/gitlab/middleware/read_only/controller.rb:40:in call' lib/gitlab/middleware/read_only.rb:16:in call’
lib/gitlab/middleware/basic_health_check.rb:25:in call' lib/gitlab/request_context.rb:18:in call’
lib/gitlab/metrics/requests_rack_middleware.rb:27:in call' lib/gitlab/middleware/release_env.rb:10:in call’
Completed 503 Service Unavailable in 566ms (Views: 8.7ms | ActiveRecord: 28.4ms | Elasticsearch: 0.0ms)
==> /var/log/gitlab/nginx/gitlab_access.log <==
192.168.0.9 - - [24/Oct/2018:16:12:40 +0300] “POST /projects HTTP/1.1” 503 2930 “http://gitlab.netio.cloud/projects/new” “Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Firefox/60.0”
==> /var/log/gitlab/gitlab-monitor/current <==
2018-10-24_13:12:41.72661 ::1 - - [24/Oct/2018:16:12:41 IDT] “GET /process HTTP/1.1” 200 3598
2018-10-24_13:12:41.72664 - -> /process
^C/opt/gitlab/embedded/lib/ruby/gems/2.4.0/gems/omnibus-ctl-0.6.0/lib/omnibus-ctl.rb:584:in system': Interrupt from /opt/gitlab/embedded/lib/ruby/gems/2.4.0/gems/omnibus-ctl-0.6.0/lib/omnibus-ctl.rb:584:in tail’
from /opt/gitlab/embedded/lib/ruby/gems/2.4.0/gems/omnibus-ctl-0.6.0/lib/omnibus-ctl.rb:746:in run' from /opt/gitlab/embedded/lib/ruby/gems/2.4.0/gems/omnibus-ctl-0.6.0/bin/omnibus-ctl:31:in <top (required)>’
from /opt/gitlab/embedded/bin/omnibus-ctl:23:in load' from /opt/gitlab/embedded/bin/omnibus-ctl:23:in ’
What is wrong on my configuration? Can anyone help me with this?
Best Regards,
Shahar