Error 500 on CI/CD Settings page

Describe your question in as much detail as possible:

  • What are you seeing, and how does it differ from what you expect to see?
    Error 500 every time someone visits the CI/CD settings page, regardless of project
  • Consider including screenshots, error messages, and/or other helpful visuals
    See log below
  • What version are you on (Hint: /help) ? and are you using self-managed or gitlab.com?
    12.9.2
  • What troubleshooting steps have you already taken? Can you link to any docs or other resources so
    we know where you have been?
    None as of yet, unsure what to do with error

Started GET “/infrastructure/gitlab/-/settings/ci_cd” for at 2020-04-25 16:10:01 +0000
Processing by Projects::Settings::CiCdController#show as HTML
Parameters: {“namespace_id”=>“infrastructure”, “project_id”=>“gitlab”}
Started POST “/api/v4/runners” for at 2020-04-25 16:10:01 +0000
Processing by Gitlab::RequestForgeryProtection::Controller#index as JSON
Parameters: {“description”=>"[FILTERED]", “run_untagged”=>true, “locked”=>false, “active”=>true, “info”=>{“name”=>“gitlab-runner”, “version”=>“12.10.1”, “revision”=>“ce065b93”, “platform”=>“linux”, “architecture”=>“amd64”, “features”=>{“variables”=>"[FILTERED]", “image”=>false, “services”=>false, “artifacts”=>false, “cache”=>false, “shared”=>false, “upload_multiple_artifacts”=>false, “upload_raw_artifacts”=>false, “session”=>false, “terminal”=>false, “refspecs”=>false, “masking”=>false, “proxy”=>false, “raw_variables”=>"[FILTERED]"}}, “token”=>"[FILTERED]", “request_forgery_protection”=>{“description”=>"[FILTERED]", “run_untagged”=>true, “locked”=>false, “active”=>true, “info”=>{“name”=>“gitlab-runner”, “version”=>“12.10.1”, “revision”=>“ce065b93”, “platform”=>“linux”, “architecture”=>“amd64”, “features”=>{“variables”=>"[FILTERED]", “image”=>false, “services”=>false, “artifacts”=>false, “cache”=>false, “shared”=>false, “upload_multiple_artifacts”=>false, “upload_raw_artifacts”=>false, “session”=>false, “terminal”=>false, “refspecs”=>false, “masking”=>false, “proxy”=>false, “raw_variables”=>"[FILTERED]"}}, “token”=>"[FILTERED]"}}
Can’t verify CSRF token authenticity.
This CSRF token verification failure is handled internally by GitLab::RequestForgeryProtection
Unlike the logs may suggest, this does not result in an actual 422 response to the user
For API requests, the only effect is that current_user will be nil for the duration of the request
Completed 422 Unprocessable Entity in 1ms (ActiveRecord: 0.0ms | Elasticsearch: 0.0ms | Allocations: 305)

OpenSSL::Cipher::CipherError ():
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/encryptor-3.0.0/lib/encryptor.rb:98:in final' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/encryptor-3.0.0/lib/encryptor.rb:98:in crypt’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/encryptor-3.0.0/lib/encryptor.rb:49:in decrypt' /srv/gitlab/lib/gitlab/crypto_helper.rb:27:in aes256_gcm_decrypt’
/srv/gitlab/app/models/concerns/token_authenticatable_strategies/encrypted.rb:45:in get_token' /srv/gitlab/app/models/concerns/token_authenticatable_strategies/base.rb:33:in ensure_token!’
/srv/gitlab/app/models/concerns/token_authenticatable.rb:43:in block in add_authentication_token_field' /srv/gitlab/app/models/application_setting_implementation.rb:293:in runners_registration_token’
/srv/gitlab/lib/gitlab/current_settings.rb:20:in method_missing' /srv/gitlab/lib/api/helpers/runner.rb:12:in runner_registration_token_valid?’
/srv/gitlab/lib/api/runner.rb:29:in block (2 levels) in <class:Runner>' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/endpoint.rb:57:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/endpoint.rb:57:in block (2 levels) in generate_api_method' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/activesupport-6.0.2/lib/active_support/notifications.rb:182:in instrument’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/endpoint.rb:56:in block in generate_api_method' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/endpoint.rb:262:in block in run’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/activesupport-6.0.2/lib/active_support/notifications.rb:182:in instrument' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/endpoint.rb:243:in run’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/endpoint.rb:313:in block in build_stack' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/base.rb:31:in call!’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/base.rb:24:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/base.rb:31:in call!’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/base.rb:24:in call' /srv/gitlab/ee/lib/gitlab/middleware/ip_restrictor.rb:14:in block in call’
/srv/gitlab/ee/lib/gitlab/ip_address_state.rb:10:in with' /srv/gitlab/ee/lib/gitlab/middleware/ip_restrictor.rb:13:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/base.rb:31:in call!' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/base.rb:24:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-oauth2-1.9.3/lib/rack/oauth2/server/resource.rb:20:in _call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-oauth2-1.9.3/lib/rack/oauth2/server/resource/bearer.rb:8:in _call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-oauth2-1.9.3/lib/rack/oauth2/server/abstract/handler.rb:17:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/error.rb:38:in block in call!’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/error.rb:37:in catch' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/error.rb:37:in call!’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/base.rb:24:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape_logging-1.8.3/lib/grape_logging/middleware/request_logger.rb:60:in block in call!’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape_logging-1.8.3/lib/grape_logging/middleware/request_logger.rb:58:in catch' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape_logging-1.8.3/lib/grape_logging/middleware/request_logger.rb:58:in call!’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/base.rb:24:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/head.rb:12:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/endpoint.rb:227:in call!' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/endpoint.rb:221:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/router/route.rb:72:in exec' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/router.rb:121:in process_route’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/router.rb:74:in block in identity' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/router.rb:93:in transaction’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/router.rb:72:in identity' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/router.rb:57:in block in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/router.rb:137:in with_optimization' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/router.rb:56:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/api.rb:119:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/api.rb:45:in call!’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/api.rb:40:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/routing/mapper.rb:19:in block in class:Constraints
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/routing/mapper.rb:48:in serve' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/journey/router.rb:49:in block in serve’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/journey/router.rb:32:in each' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/journey/router.rb:32:in serve’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/routing/route_set.rb:837:in call' /srv/gitlab/lib/gitlab/middleware/rails_queue_duration.rb:27:in call’
/srv/gitlab/lib/gitlab/metrics/rack_middleware.rb:17:in block in call' /srv/gitlab/lib/gitlab/metrics/transaction.rb:62:in run’
/srv/gitlab/lib/gitlab/metrics/rack_middleware.rb:17:in call' /srv/gitlab/lib/gitlab/request_profiler/middleware.rb:17:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/gitlab-labkit-0.11.0/lib/labkit/middleware/rack.rb:19:in block in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/gitlab-labkit-0.11.0/lib/labkit/context.rb:31:in with_context’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/gitlab-labkit-0.11.0/lib/labkit/middleware/rack.rb:18:in call' /srv/gitlab/ee/lib/gitlab/jira/middleware.rb:19:in call’
/srv/gitlab/lib/gitlab/middleware/go.rb:20:in call' /srv/gitlab/lib/gitlab/etag_caching/middleware.rb:13:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/batch-loader-1.4.0/lib/batch_loader/middleware.rb:11:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/apollo_upload_server-2.0.0.beta.3/lib/apollo_upload_server/middleware.rb:20:in call’
/srv/gitlab/lib/gitlab/middleware/multipart.rb:121:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-attack-6.2.0/lib/rack/attack.rb:169:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/warden-1.2.8/lib/warden/manager.rb:36:in block in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/warden-1.2.8/lib/warden/manager.rb:34:in catch’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/warden-1.2.8/lib/warden/manager.rb:34:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-cors-1.0.6/lib/rack/cors.rb:98:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/tempfile_reaper.rb:15:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/etag.rb:25:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/conditional_get.rb:38:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/head.rb:12:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/http/content_security_policy.rb:18:in call' /srv/gitlab/lib/gitlab/middleware/read_only/controller.rb:53:in call’
/srv/gitlab/lib/gitlab/middleware/read_only.rb:18:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/session/abstract/id.rb:232:in context’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/session/abstract/id.rb:226:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/cookies.rb:648:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/callbacks.rb:27:in block in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/activesupport-6.0.2/lib/active_support/callbacks.rb:101:in run_callbacks’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/callbacks.rb:26:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/actionable_exceptions.rb:17:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/debug_exceptions.rb:32:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/show_exceptions.rb:33:in call’
/srv/gitlab/lib/gitlab/middleware/basic_health_check.rb:25:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/railties-6.0.2/lib/rails/rack/logger.rb:38:in call_app’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/railties-6.0.2/lib/rails/rack/logger.rb:26:in block in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/activesupport-6.0.2/lib/active_support/tagged_logging.rb:80:in block in tagged’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/activesupport-6.0.2/lib/active_support/tagged_logging.rb:28:in tagged' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/activesupport-6.0.2/lib/active_support/tagged_logging.rb:80:in tagged’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/railties-6.0.2/lib/rails/rack/logger.rb:26:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/remote_ip.rb:81:in call’
/srv/gitlab/lib/gitlab/middleware/request_context.rb:23:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/request_store-1.3.1/lib/request_store/middleware.rb:9:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/request_id.rb:27:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/method_override.rb:22:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/runtime.rb:22:in call' /srv/gitlab/config/initializers/fix_local_cache_middleware.rb:9:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/executor.rb:14:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/lock.rb:17:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/sendfile.rb:111:in call' /srv/gitlab/lib/gitlab/metrics/requests_rack_middleware.rb:49:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/host_authorization.rb:77:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/sentry-raven-2.9.0/lib/raven/integrations/rack.rb:51:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/railties-6.0.2/lib/rails/engine.rb:526:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/railties-6.0.2/lib/rails/railtie.rb:190:in public_send’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/railties-6.0.2/lib/rails/railtie.rb:190:in method_missing' /srv/gitlab/lib/gitlab/middleware/release_env.rb:12:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/urlmap.rb:68:in block in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/urlmap.rb:53:in each’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/urlmap.rb:53:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/unicorn-5.4.1/lib/unicorn/http_server.rb:606:in process_client’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/unicorn-worker-killer-0.4.4/lib/unicorn/worker_killer.rb:52:in process_client' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/unicorn-5.4.1/lib/unicorn/http_server.rb:701:in worker_loop’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/unicorn-5.4.1/lib/unicorn/http_server.rb:549:in spawn_missing_workers' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/unicorn-5.4.1/lib/unicorn/http_server.rb:142:in start’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/unicorn-5.4.1/bin/unicorn:126:in <top (required)>' /srv/gitlab/vendor/bundle/ruby/2.6.0/bin/unicorn:23:in load’
/srv/gitlab/vendor/bundle/ruby/2.6.0/bin/unicorn:23:in <top (required)>' /usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/cli/exec.rb:74:in load’
/usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/cli/exec.rb:74:in kernel_load' /usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/cli/exec.rb:28:in run’
/usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/cli.rb:463:in exec' /usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/vendor/thor/lib/thor/command.rb:27:in run’
/usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/vendor/thor/lib/thor/invocation.rb:126:in invoke_command' /usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/vendor/thor/lib/thor.rb:387:in dispatch’
/usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/cli.rb:27:in dispatch' /usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/vendor/thor/lib/thor/base.rb:466:in start’
/usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/cli.rb:18:in start' /usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/exe/bundle:30:in block in <top (required)>’
/usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/friendly_errors.rb:124:in with_friendly_errors' /usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/exe/bundle:22:in <top (required)>’
/srv/gitlab/bin/bundle:3:in load' /srv/gitlab/bin/bundle:3:in

==> /var/log/gitlab/api_json.log <==
{“time”:“2020-04-25T16:10:01.348Z”,“severity”:“INFO”,“duration”:9.91,“db”:0.63,“view”:9.28,“status”:500,“method”:“POST”,“path”:"/api/v4/runners",“params”:[{“key”:“description”,“value”:"[FILTERED]"},{“key”:“run_untagged”,“value”:null},{“key”:“locked”,“value”:null},{“key”:“active”,“value”:null},{“key”:“info”,“value”:{“name”:“gitlab-runner”,“version”:“12.10.1”,“revision”:“ce065b93”,“platform”:“linux”,“architecture”:“amd64”,“features”:{“variables”:"[FILTERED]",“image”:null,“services”:null,“artifacts”:null,“cache”:null,“shared”:null,“upload_multiple_artifacts”:null,“upload_raw_artifacts”:null,“session”:null,“terminal”:null,“refspecs”:null,“masking”:null,“proxy”:null,“raw_variables”:"[FILTERED]"}}},{“key”:“token”,“value”:"[FILTERED]"}],“host”:“conductor.dev”,“remote_ip”:", “,“ua”:“gitlab-runner 12.10.1 (12-10-stable; go1.13.8; linux/amd64)”,“route”:”/api/:version/runners",“exception.class”:“OpenSSL::Cipher::CipherError”,“exception.message”:"",“exception.backtrace”:[“lib/gitlab/crypto_helper.rb:27:in aes256_gcm_decrypt'","app/models/concerns/token_authenticatable_strategies/encrypted.rb:45:in get_token’”,“app/models/concerns/token_authenticatable_strategies/base.rb:33:in ensure_token!'","app/models/concerns/token_authenticatable.rb:43:in block in add_authentication_token_field’”,“app/models/application_setting_implementation.rb:293:in runners_registration_token'","lib/gitlab/current_settings.rb:20:in method_missing’”,“lib/api/helpers/runner.rb:12:in runner_registration_token_valid?'","lib/api/runner.rb:29:in block (2 levels) in class:Runner’”,“ee/lib/gitlab/ip_address_state.rb:10:in with'","ee/lib/gitlab/jira/middleware.rb:19:in call’”],“queue_duration”:20.5,“correlation_id”:“dgrMrFLgna7”}

==> /var/log/gitlab/production.log <==
Completed 500 Internal Server Error in 179ms (ActiveRecord: 42.8ms | Elasticsearch: 0.0ms | Allocations: 32220)

==> /var/log/gitlab/production_json.log <==
{“method”:“GET”,“path”:"/infrastructure/gitlab/-/settings/ci_cd",“format”:“html”,“controller”:“Projects::Settings::CiCdController”,“action”:“show”,“status”:500,“duration”:179.02,“view”:0.0,“db”:42.82,“time”:“2020-04-25T16:10:01.409Z”,“params”:[{“key”:“namespace_id”,“value”:“infrastructure”},{“key”:“project_id”,“value”:“gitlab”}],“remote_ip”:"",“user_id”:2,“username”:“shamil”,“ua”:“Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_4) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1 Safari/605.1.15”,“queue_duration”:16.06,“gitaly_calls”:1,“gitaly_duration”:55.98,“correlation_id”:“Og6Apgl4zE3”,“cpu_s”:0.22816965200000006,“exception.class”:“ActionView::Template::Error”,“exception.message”:"",“exception.backtrace”:[“lib/gitlab/crypto_helper.rb:27:in aes256_gcm_decrypt'","app/models/concerns/token_authenticatable_strategies/encrypted.rb:45:in get_token’”,“app/models/concerns/token_authenticatable_strategies/base.rb:33:in ensure_token!'","app/models/concerns/token_authenticatable.rb:43:in block in add_authentication_token_field’”,“app/models/project.rb:1701:in runners_token'","app/views/projects/runners/_specific_runners.html.haml:9","app/views/projects/runners/_index.html.haml:8","app/views/projects/settings/ci_cd/show.html.haml:47","ee/app/helpers/ee/application_helper.rb:43:in render_ce’”,“ee/app/views/projects/settings/ci_cd/show.html.haml:1”,“app/controllers/application_controller.rb:125:in render'","ee/lib/gitlab/ip_address_state.rb:10:in with’”,“ee/app/controllers/ee/application_controller.rb:43:in set_current_ip_address'","app/controllers/application_controller.rb:479:in set_current_admin’”,“lib/gitlab/session.rb:11:in with_session'","app/controllers/application_controller.rb:470:in set_session_storage’”,“app/controllers/application_controller.rb:464:in set_locale'","lib/gitlab/error_tracking.rb:34:in with_context’”,“app/controllers/application_controller.rb:555:in sentry_context'","lib/gitlab/application_context.rb:46:in block in use’”,“lib/gitlab/application_context.rb:46:in use'","lib/gitlab/application_context.rb:19:in with_context’”,“app/controllers/application_controller.rb:455:in set_current_context'","ee/lib/gitlab/jira/middleware.rb:19:in call’”]}

==> /var/log/gitlab/production.log <==

ActionView::Template::Error ():
6: locals: { type: ‘specific’,
7: clusters_path: project_clusters_path(@project) }
8: %hr
9: = render partial: ‘ci/runner/how_to_setup_runner’,
10: locals: { registration_token: @project.runners_token,
11: type: ‘specific’,
12: reset_token_url: reset_registration_token_namespace_project_settings_ci_cd_path }

lib/gitlab/crypto_helper.rb:27:in aes256_gcm_decrypt' app/models/concerns/token_authenticatable_strategies/encrypted.rb:45:in get_token’
app/models/concerns/token_authenticatable_strategies/base.rb:33:in ensure_token!' app/models/concerns/token_authenticatable.rb:43:in block in add_authentication_token_field’
app/models/project.rb:1701:in runners_token' app/views/projects/runners/_specific_runners.html.haml:9 app/views/projects/runners/_index.html.haml:8 app/views/projects/settings/ci_cd/show.html.haml:47 ee/app/helpers/ee/application_helper.rb:43:in render_ce’
ee/app/views/projects/settings/ci_cd/show.html.haml:1
app/controllers/application_controller.rb:125:in render' ee/lib/gitlab/ip_address_state.rb:10:in with’
ee/app/controllers/ee/application_controller.rb:43:in set_current_ip_address' app/controllers/application_controller.rb:479:in set_current_admin’
lib/gitlab/session.rb:11:in with_session' app/controllers/application_controller.rb:470:in set_session_storage’
lib/gitlab/i18n.rb:55:in with_locale' lib/gitlab/i18n.rb:61:in with_user_locale’
app/controllers/application_controller.rb:464:in set_locale' lib/gitlab/error_tracking.rb:34:in with_context’
app/controllers/application_controller.rb:555:in sentry_context' lib/gitlab/application_context.rb:46:in block in use’
lib/gitlab/application_context.rb:46:in use' lib/gitlab/application_context.rb:19:in with_context’
app/controllers/application_controller.rb:455:in set_current_context' lib/gitlab/middleware/rails_queue_duration.rb:27:in call’
lib/gitlab/metrics/rack_middleware.rb:17:in block in call' lib/gitlab/metrics/transaction.rb:62:in run’
lib/gitlab/metrics/rack_middleware.rb:17:in call' lib/gitlab/request_profiler/middleware.rb:17:in call’
ee/lib/gitlab/jira/middleware.rb:19:in call' lib/gitlab/middleware/go.rb:20:in call’
lib/gitlab/etag_caching/middleware.rb:13:in call' lib/gitlab/middleware/multipart.rb:121:in call’
lib/gitlab/middleware/read_only/controller.rb:53:in call' lib/gitlab/middleware/read_only.rb:18:in call’
lib/gitlab/middleware/basic_health_check.rb:25:in call' lib/gitlab/middleware/request_context.rb:23:in call’
config/initializers/fix_local_cache_middleware.rb:9:in call' lib/gitlab/metrics/requests_rack_middleware.rb:49:in call’
lib/gitlab/middleware/release_env.rb:12:in `call’
Started GET “/-/readiness” for at 2020-04-25 16:10:02 +0000
Processing by HealthController#readiness as HTML
Completed 200 OK in 1ms (Views: 0.3ms | ActiveRecord: 0.0ms | Elasticsearch: 0.0ms | Allocations: 263)

==> /var/log/gitlab/production_json.log <==
{“method”:“GET”,“path”:"/-/readiness",“format”:“html”,“controller”:“HealthController”,“action”:“readiness”,“status”:200,“duration”:1.38,“view”:0.31,“db”:0.0,“time”:“2020-04-25T16:10:02.724Z”,“params”:,“remote_ip”:null,“user_id”:null,“username”:null,“ua”:null,“queue_duration”:null,“correlation_id”:“13a488ee-fa51-457c-8956-97fc9525b0ed”,“cpu_s”:0.008163636999999113}

==> /var/log/gitlab/production.log <==
Started POST “/api/v4/runners” for at 2020-04-25 16:10:11 +0000
Processing by Gitlab::RequestForgeryProtection::Controller#index as JSON
Parameters: {“description”=>"[FILTERED]", “run_untagged”=>true, “locked”=>false, “active”=>true, “info”=>{“name”=>“gitlab-runner”, “version”=>“12.10.1”, “revision”=>“ce065b93”, “platform”=>“linux”, “architecture”=>“amd64”, “features”=>{“variables”=>"[FILTERED]", “image”=>false, “services”=>false, “artifacts”=>false, “cache”=>false, “shared”=>false, “upload_multiple_artifacts”=>false, “upload_raw_artifacts”=>false, “session”=>false, “terminal”=>false, “refspecs”=>false, “masking”=>false, “proxy”=>false, “raw_variables”=>"[FILTERED]"}}, “token”=>"[FILTERED]", “request_forgery_protection”=>{“description”=>"[FILTERED]", “run_untagged”=>true, “locked”=>false, “active”=>true, “info”=>{“name”=>“gitlab-runner”, “version”=>“12.10.1”, “revision”=>“ce065b93”, “platform”=>“linux”, “architecture”=>“amd64”, “features”=>{“variables”=>"[FILTERED]", “image”=>false, “services”=>false, “artifacts”=>false, “cache”=>false, “shared”=>false, “upload_multiple_artifacts”=>false, “upload_raw_artifacts”=>false, “session”=>false, “terminal”=>false, “refspecs”=>false, “masking”=>false, “proxy”=>false, “raw_variables”=>"[FILTERED]"}}, “token”=>"[FILTERED]"}}
Can’t verify CSRF token authenticity.
This CSRF token verification failure is handled internally by GitLab::RequestForgeryProtection
Unlike the logs may suggest, this does not result in an actual 422 response to the user
For API requests, the only effect is that current_user will be nil for the duration of the request
Completed 422 Unprocessable Entity in 1ms (ActiveRecord: 0.0ms | Elasticsearch: 0.0ms | Allocations: 305)

OpenSSL::Cipher::CipherError ():
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/encryptor-3.0.0/lib/encryptor.rb:98:in final' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/encryptor-3.0.0/lib/encryptor.rb:98:in crypt’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/encryptor-3.0.0/lib/encryptor.rb:49:in decrypt' /srv/gitlab/lib/gitlab/crypto_helper.rb:27:in aes256_gcm_decrypt’
/srv/gitlab/app/models/concerns/token_authenticatable_strategies/encrypted.rb:45:in get_token' /srv/gitlab/app/models/concerns/token_authenticatable_strategies/base.rb:33:in ensure_token!’
/srv/gitlab/app/models/concerns/token_authenticatable.rb:43:in block in add_authentication_token_field' /srv/gitlab/app/models/application_setting_implementation.rb:293:in runners_registration_token’
/srv/gitlab/lib/gitlab/current_settings.rb:20:in method_missing' /srv/gitlab/lib/api/helpers/runner.rb:12:in runner_registration_token_valid?’
/srv/gitlab/lib/api/runner.rb:29:in block (2 levels) in <class:Runner>' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/endpoint.rb:57:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/endpoint.rb:57:in block (2 levels) in generate_api_method' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/activesupport-6.0.2/lib/active_support/notifications.rb:182:in instrument’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/endpoint.rb:56:in block in generate_api_method' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/endpoint.rb:262:in block in run’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/activesupport-6.0.2/lib/active_support/notifications.rb:182:in instrument' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/endpoint.rb:243:in run’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/endpoint.rb:313:in block in build_stack' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/base.rb:31:in call!’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/base.rb:24:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/base.rb:31:in call!’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/base.rb:24:in call' /srv/gitlab/ee/lib/gitlab/middleware/ip_restrictor.rb:14:in block in call’
/srv/gitlab/ee/lib/gitlab/ip_address_state.rb:10:in with' /srv/gitlab/ee/lib/gitlab/middleware/ip_restrictor.rb:13:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/base.rb:31:in call!' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/base.rb:24:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-oauth2-1.9.3/lib/rack/oauth2/server/resource.rb:20:in _call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-oauth2-1.9.3/lib/rack/oauth2/server/resource/bearer.rb:8:in _call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-oauth2-1.9.3/lib/rack/oauth2/server/abstract/handler.rb:17:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/error.rb:38:in block in call!’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/error.rb:37:in catch' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/error.rb:37:in call!’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/base.rb:24:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape_logging-1.8.3/lib/grape_logging/middleware/request_logger.rb:60:in block in call!’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape_logging-1.8.3/lib/grape_logging/middleware/request_logger.rb:58:in catch' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape_logging-1.8.3/lib/grape_logging/middleware/request_logger.rb:58:in call!’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/middleware/base.rb:24:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/head.rb:12:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/endpoint.rb:227:in call!' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/endpoint.rb:221:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/router/route.rb:72:in exec' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/router.rb:121:in process_route’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/router.rb:74:in block in identity' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/router.rb:93:in transaction’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/router.rb:72:in identity' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/router.rb:57:in block in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/router.rb:137:in with_optimization' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/router.rb:56:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/api.rb:119:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/api.rb:45:in call!’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/grape-1.1.0/lib/grape/api.rb:40:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/routing/mapper.rb:19:in block in class:Constraints
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/routing/mapper.rb:48:in serve' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/journey/router.rb:49:in block in serve’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/journey/router.rb:32:in each' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/journey/router.rb:32:in serve’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/routing/route_set.rb:837:in call' /srv/gitlab/lib/gitlab/middleware/rails_queue_duration.rb:27:in call’
/srv/gitlab/lib/gitlab/metrics/rack_middleware.rb:17:in block in call' /srv/gitlab/lib/gitlab/metrics/transaction.rb:62:in run’
/srv/gitlab/lib/gitlab/metrics/rack_middleware.rb:17:in call' /srv/gitlab/lib/gitlab/request_profiler/middleware.rb:17:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/gitlab-labkit-0.11.0/lib/labkit/middleware/rack.rb:19:in block in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/gitlab-labkit-0.11.0/lib/labkit/context.rb:31:in with_context’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/gitlab-labkit-0.11.0/lib/labkit/middleware/rack.rb:18:in call' /srv/gitlab/ee/lib/gitlab/jira/middleware.rb:19:in call’
/srv/gitlab/lib/gitlab/middleware/go.rb:20:in call' /srv/gitlab/lib/gitlab/etag_caching/middleware.rb:13:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/batch-loader-1.4.0/lib/batch_loader/middleware.rb:11:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/apollo_upload_server-2.0.0.beta.3/lib/apollo_upload_server/middleware.rb:20:in call’
/srv/gitlab/lib/gitlab/middleware/multipart.rb:121:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-attack-6.2.0/lib/rack/attack.rb:169:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/warden-1.2.8/lib/warden/manager.rb:36:in block in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/warden-1.2.8/lib/warden/manager.rb:34:in catch’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/warden-1.2.8/lib/warden/manager.rb:34:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-cors-1.0.6/lib/rack/cors.rb:98:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/tempfile_reaper.rb:15:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/etag.rb:25:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/conditional_get.rb:38:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/head.rb:12:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/http/content_security_policy.rb:18:in call' /srv/gitlab/lib/gitlab/middleware/read_only/controller.rb:53:in call’
/srv/gitlab/lib/gitlab/middleware/read_only.rb:18:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/session/abstract/id.rb:232:in context’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/session/abstract/id.rb:226:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/cookies.rb:648:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/callbacks.rb:27:in block in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/activesupport-6.0.2/lib/active_support/callbacks.rb:101:in run_callbacks’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/callbacks.rb:26:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/actionable_exceptions.rb:17:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/debug_exceptions.rb:32:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/show_exceptions.rb:33:in call’
/srv/gitlab/lib/gitlab/middleware/basic_health_check.rb:25:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/railties-6.0.2/lib/rails/rack/logger.rb:38:in call_app’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/railties-6.0.2/lib/rails/rack/logger.rb:26:in block in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/activesupport-6.0.2/lib/active_support/tagged_logging.rb:80:in block in tagged’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/activesupport-6.0.2/lib/active_support/tagged_logging.rb:28:in tagged' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/activesupport-6.0.2/lib/active_support/tagged_logging.rb:80:in tagged’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/railties-6.0.2/lib/rails/rack/logger.rb:26:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/remote_ip.rb:81:in call’
/srv/gitlab/lib/gitlab/middleware/request_context.rb:23:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/request_store-1.3.1/lib/request_store/middleware.rb:9:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/request_id.rb:27:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/method_override.rb:22:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/runtime.rb:22:in call' /srv/gitlab/config/initializers/fix_local_cache_middleware.rb:9:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/executor.rb:14:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/lock.rb:17:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/sendfile.rb:111:in call' /srv/gitlab/lib/gitlab/metrics/requests_rack_middleware.rb:49:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/actionpack-6.0.2/lib/action_dispatch/middleware/host_authorization.rb:77:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/sentry-raven-2.9.0/lib/raven/integrations/rack.rb:51:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/railties-6.0.2/lib/rails/engine.rb:526:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/railties-6.0.2/lib/rails/railtie.rb:190:in public_send’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/railties-6.0.2/lib/rails/railtie.rb:190:in method_missing' /srv/gitlab/lib/gitlab/middleware/release_env.rb:12:in call’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/urlmap.rb:68:in block in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/urlmap.rb:53:in each’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/rack-2.0.7/lib/rack/urlmap.rb:53:in call' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/unicorn-5.4.1/lib/unicorn/http_server.rb:606:in process_client’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/unicorn-worker-killer-0.4.4/lib/unicorn/worker_killer.rb:52:in process_client' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/unicorn-5.4.1/lib/unicorn/http_server.rb:701:in worker_loop’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/unicorn-5.4.1/lib/unicorn/http_server.rb:549:in spawn_missing_workers' /srv/gitlab/vendor/bundle/ruby/2.6.0/gems/unicorn-5.4.1/lib/unicorn/http_server.rb:142:in start’
/srv/gitlab/vendor/bundle/ruby/2.6.0/gems/unicorn-5.4.1/bin/unicorn:126:in <top (required)>' /srv/gitlab/vendor/bundle/ruby/2.6.0/bin/unicorn:23:in load’
/srv/gitlab/vendor/bundle/ruby/2.6.0/bin/unicorn:23:in <top (required)>' /usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/cli/exec.rb:74:in load’
/usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/cli/exec.rb:74:in kernel_load' /usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/cli/exec.rb:28:in run’
/usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/cli.rb:463:in exec' /usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/vendor/thor/lib/thor/command.rb:27:in run’
/usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/vendor/thor/lib/thor/invocation.rb:126:in invoke_command' /usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/vendor/thor/lib/thor.rb:387:in dispatch’
/usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/cli.rb:27:in dispatch' /usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/vendor/thor/lib/thor/base.rb:466:in start’
/usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/cli.rb:18:in start' /usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/exe/bundle:30:in block in <top (required)>’
/usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/lib/bundler/friendly_errors.rb:124:in with_friendly_errors' /usr/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/exe/bundle:22:in <top (required)>’
/srv/gitlab/bin/bundle:3:in load' /srv/gitlab/bin/bundle:3:in

This work for me with sameersbn/gitlab docker 15 after backup /restore a gitlab 11 backup

$ docker exec -it  gitlab-postgresql bash
root@33f434c47049:/var/lib/postgresql# su - postgres
postgres@33f434c47049:~$  psql gitlabhq_production
gitlabhq_production=# UPDATE projects SET runners_token = null, runners_token_encrypted = null;
UPDATE 21
gitlabhq_production=# UPDATE namespaces SET runners_token = null, runners_token_encrypted = null;
UPDATE 38
gitlabhq_production=# UPDATE application_settings SET runners_registration_token_encrypted = null;
UPDATE 1
gitlabhq_production=# UPDATE ci_runners SET token = null, token_encrypted = null;

then the error 500 on CI/CD goes away