Error 500 when modifying GitLab configuration

Component version

  • k8s 1.25.9
  • GitLab 15.4.6
  • Helm GitLab 6.4.6
  • GitLab Shell14.10.0
  • GitLab Workhorsev15.4.6
  • GitLab APIv4
  • GitLab KAS15.4.0
  • Ruby2.7.6p219
  • Rails6.1.6.1
  • PostgreSQL13.6
  • Redis6.0.9

values.yaml

global:
  edition: ce
  hosts:
    https: false
    domain: git.xxx.com
    gitlab:
      name: git.xxx.com
    ssh:
      name: git.xxx.com
    minio:
      name: minio.git.xxx.com
      https: false
    kas:
      https: false
      tls:
        enabled: false
  ingress:
    class: nginx
    tls:
      secretName: https-secret
    annotations:
      nginx.ingress.kubernetes.io/ssl-redirect: "false"
  praefect:
    ntpHost: 172.88.0.1
  kas:
    tls:
      enabled: false
  appConfig:
    defaultProjectsFeatures:
      containerRegistry: false

postgresql:
  image:
    tag: 13.6.0
  global:
    storageClass: app-cephfs
  persistence:
    size: 20Gi

redis:
  global:
    storageClass: app-cephfs-del

minio:
  ingress:
    tls:
      enabled: false
      secretName: https-secret
  persistence:
    enabled: true
    claimName: gitlab-minio

gitlab:
  kas:
    privateApi:
      tls:
        enabled: false
  gitaly:
    persistence:
      storageClass: app-cephfs
      size: 200Gi
  toolbox:
    persistence:
      enabled: true
      storageClass: app-cephfs-del
      size: 1Ti
    backups:
      cron:
        enabled: true
        schedule: "0 3 * * * "
        persistence:
          enabled: true
          storageClass: app-cephfs-del
          size: 1Ti

nginx-ingress:
  enabled: false
gitlab-runner:
  install: false
prometheus:
  install: false
certmanager:
  install: false
gitlab-exporter:
  enabled: false
registry:
  enabled: false

kubectl get pod

[root@master1 gitlab]# kubectl get pod
NAME                                         READY   STATUS      RESTARTS   AGE
gitlab-gitaly-0                              1/1     Running     0          4d15h
gitlab-gitlab-exporter-86c6959b4f-x2zbp      1/1     Running     0          4d15h
gitlab-gitlab-shell-6dd455ddd-2r42c          1/1     Running     0          4d15h
gitlab-gitlab-shell-6dd455ddd-ppssc          1/1     Running     0          4d15h
gitlab-kas-f5c497df9-8ddfp                   1/1     Running     0          4d15h
gitlab-kas-f5c497df9-frfsp                   1/1     Running     0          4d15h
gitlab-minio-74467697bb-dpckt                1/1     Running     0          4d15h
gitlab-minio-create-buckets-3-xqll4          0/1     Completed   0          4d12h
gitlab-postgresql-0                          2/2     Running     0          4d15h
gitlab-redis-master-0                        2/2     Running     0          4d15h
gitlab-sidekiq-all-in-1-v2-dffd9dc9d-l2mdp   1/1     Running     0          4d14h
gitlab-toolbox-74b769878d-pklrr              1/1     Running     0          4d15h
gitlab-toolbox-backup-28057140-jr9r8         0/1     Completed   0          2d2h
gitlab-toolbox-backup-28058580-kqw2v         0/1     Completed   0          26h
gitlab-toolbox-backup-28060020-d692n         0/1     Completed   0          140m
gitlab-webservice-default-78568cd68f-9cm24   2/2     Running     0          4d14h
gitlab-webservice-default-78568cd68f-jv4zq   2/2     Running     0          4d14h

Error log

Error 500 when trying to modify the configuration for Admin -> Settings -> Repository -> Default branch -> Initial default branch name

Started PATCH "/admin/application_settings/repository" for 172.88.0.47 at 2023-05-09 04:53:31 +0000
Processing by Admin::ApplicationSettingsController#repository as HTML
  Parameters: {"authenticity_token"=>"[FILTERED]", "application_setting"=>{"default_branch_name"=>"master", "default_branch_protection"=>"2"}}
Completed 500 Internal Server Error in 29ms (ActiveRecord: 6.2ms | Elasticsearch: 0.0ms | Allocations: 13009)
  
OpenSSL::Cipher::CipherError ():
  
lib/gitlab/database/load_balancing/connection_proxy.rb:120:in `block in write_using_load_balancer'
lib/gitlab/database/load_balancing/load_balancer.rb:115:in `block in read_write'
lib/gitlab/database/load_balancing/load_balancer.rb:184:in `retry_with_backoff'
lib/gitlab/database/load_balancing/load_balancer.rb:111:in `read_write'
lib/gitlab/database/load_balancing/connection_proxy.rb:119:in `write_using_load_balancer'
lib/gitlab/database/load_balancing/connection_proxy.rb:71:in `transaction'
app/services/application_settings/update_service.rb:50:in `update_settings'
app/services/application_settings/update_service.rb:12:in `execute'
app/controllers/admin/application_settings_controller.rb:295:in `perform_update'
app/controllers/admin/application_settings_controller.rb:59:in `block (2 levels) in <class:ApplicationSettingsController>'
app/controllers/application_controller.rb:531:in `set_current_admin'
lib/gitlab/session.rb:11:in `with_session'
app/controllers/application_controller.rb:522:in `set_session_storage'
lib/gitlab/i18n.rb:107:in `with_locale'
lib/gitlab/i18n.rb:113:in `with_user_locale'
app/controllers/application_controller.rb:516:in `set_locale'
app/controllers/application_controller.rb:510:in `set_current_context'
lib/gitlab/metrics/elasticsearch_rack_middleware.rb:16:in `call'
lib/gitlab/middleware/memory_report.rb:13:in `call'
lib/gitlab/middleware/speedscope.rb:13:in `call'
lib/gitlab/database/load_balancing/rack_middleware.rb:23:in `call'
lib/gitlab/middleware/rails_queue_duration.rb:33:in `call'
lib/gitlab/metrics/rack_middleware.rb:16:in `block in call'
lib/gitlab/metrics/web_transaction.rb:46:in `run'
lib/gitlab/metrics/rack_middleware.rb:16:in `call'
lib/gitlab/jira/middleware.rb:19:in `call'
lib/gitlab/middleware/go.rb:20:in `call'
lib/gitlab/etag_caching/middleware.rb:21:in `call'
lib/gitlab/middleware/query_analyzer.rb:11:in `block in call'
lib/gitlab/database/query_analyzer.rb:37:in `within'
lib/gitlab/middleware/query_analyzer.rb:11:in `call'
lib/gitlab/middleware/multipart.rb:173:in `call'
lib/gitlab/middleware/read_only/controller.rb:50:in `call'
lib/gitlab/middleware/read_only.rb:18:in `call'
lib/gitlab/middleware/same_site_cookies.rb:27:in `call'
lib/gitlab/middleware/handle_malformed_strings.rb:21:in `call'
lib/gitlab/middleware/basic_health_check.rb:25:in `call'
lib/gitlab/middleware/handle_ip_spoof_attack_error.rb:25:in `call'
lib/gitlab/middleware/request_context.rb:21:in `call'
lib/gitlab/middleware/webhook_recursion_detection.rb:15:in `call'
config/initializers/fix_local_cache_middleware.rb:11:in `call'
lib/gitlab/middleware/compressed_json.rb:26:in `call'
lib/gitlab/middleware/rack_multipart_tempfile_factory.rb:19:in `call'
lib/gitlab/middleware/sidekiq_web_static.rb:20:in `call'
lib/gitlab/metrics/requests_rack_middleware.rb:77:in `call'
lib/gitlab/middleware/release_env.rb:13:in `call'

I have checked the error log but did not find any useful information. What could be the problem? How can I troubleshoot this?