Hello we have a problem during upgrade on-premise gitlab from 18.3.1 to 18.4.0
# cat /opt/gitlab/embedded/cookbooks/cache/cinc-stacktrace.out
Generated at 2025-09-19 07:57:52 +0200
Chef::Exceptions::RecipeNotFound: could not find recipe config for cookbook gitlab
/opt/gitlab/embedded/lib/ruby/gems/3.2.0/gems/chef-18.3.0/lib/chef/cookbook_version.rb:207:in `load_recipe'
/opt/gitlab/embedded/lib/ruby/gems/3.2.0/gems/chef-18.3.0/lib/chef/run_context.rb:429:in `load_recipe'
/opt/gitlab/embedded/lib/ruby/gems/3.2.0/gems/chef-18.3.0/lib/chef/run_context/cookbook_compiler.rb:228:in `block in compile_recipes'
/opt/gitlab/embedded/lib/ruby/gems/3.2.0/gems/chef-18.3.0/lib/chef/run_context/cookbook_compiler.rb:225:in `each'
/opt/gitlab/embedded/lib/ruby/gems/3.2.0/gems/chef-18.3.0/lib/chef/run_context/cookbook_compiler.rb:225:in `compile_recipes'
/opt/gitlab/embedded/lib/ruby/gems/3.2.0/gems/chef-18.3.0/lib/chef/run_context/cookbook_compiler.rb:109:in `compile'
/opt/gitlab/embedded/lib/ruby/gems/3.2.0/gems/chef-18.3.0/lib/chef/run_context.rb:259:in `load'
/opt/gitlab/embedded/lib/ruby/gems/3.2.0/gems/chef-18.3.0/lib/chef/policy_builder/expand_node_object.rb:103:in `setup_run_context'
/opt/gitlab/embedded/lib/ruby/gems/3.2.0/gems/forwardable-1.3.3/lib/forwardable.rb:240:in `setup_run_context'
/opt/gitlab/embedded/lib/ruby/gems/3.2.0/gems/chef-18.3.0/lib/chef/client.rb:499:in `setup_run_context'
/opt/gitlab/embedded/lib/ruby/gems/3.2.0/gems/chef-18.3.0/lib/chef/client.rb:294:in `run'
/opt/gitlab/embedded/lib/ruby/gems/3.2.0/gems/chef-18.3.0/lib/chef/application.rb:305:in `run_with_graceful_exit_option'
/opt/gitlab/embedded/lib/ruby/gems/3.2.0/gems/chef-18.3.0/lib/chef/application.rb:281:in `block in run_chef_client'
/opt/gitlab/embedded/lib/ruby/gems/3.2.0/gems/chef-18.3.0/lib/chef/local_mode.rb:42:in `with_server_connectivity'
/opt/gitlab/embedded/lib/ruby/gems/3.2.0/gems/chef-18.3.0/lib/chef/application.rb:264:in `run_chef_client'
/opt/gitlab/embedded/lib/ruby/gems/3.2.0/gems/chef-18.3.0/lib/chef/application/base.rb:354:in `run_application'
/opt/gitlab/embedded/lib/ruby/gems/3.2.0/gems/chef-18.3.0/lib/chef/application.rb:67:in `run'
/opt/gitlab/embedded/lib/ruby/gems/3.2.0/gems/chef-bin-18.3.0/bin/cinc-client:25:in `<top (required)>'
/opt/gitlab/embedded/lib/ruby/site_ruby/3.2.0/rubygems.rb:319:in `load'
/opt/gitlab/embedded/lib/ruby/site_ruby/3.2.0/rubygems.rb:319:in `activate_and_load_bin_path'
# apt upgrade
NaÄŤĂtajĂ se seznamy balĂků… Hotovo
Vytvářà se strom závislostĂ… Hotovo
NaÄŤĂtajĂ se stavovĂ© informace… Hotovo
PropoÄŤĂtává se aktualizace… Hotovo
NásledujĂcĂ balĂky byly nainstalovány automaticky a jiĹľ nejsou potĹ™eba:
linux-image-6.1.0-34-amd64 linux-image-6.1.0-37-amd64
Pro jejich odstraněnà použijte „apt autoremove“.
NásledujĂcĂ balĂky budou aktualizovány:
filebeat gitlab-ce
2 aktualizováno, 0 nově instalováno, 0 k odstraněnà a 0 neaktualizováno.
Nutno stáhnout 1 525 MB archivů.
Po tĂ©to operaci bude na disku pouĹľito dalšĂch 38,6 MB.
Chcete pokraÄŤovat? [Y/n] y
Stahuje se:1 https://artifacts.elastic.co/packages/8.x/apt stable/main amd64 filebeat amd64 8.19.4 [66,0 MB]
Stahuje se:2 https://packages.gitlab.com/gitlab/gitlab-ce/debian bookworm/main amd64 gitlab-ce amd64 18.4.0-ce.0 [1 459 MB]
StaĹľeno 1 525 MB za 1min 21s (18,9 MB/s)
NaÄŤĂtám soubory se zmÄ›nami... Hotovo
(NaÄŤĂtá se databáze … nynĂ je nainstalováno 160155 souborĹŻ a adresářů.)
Připravuje se nahrazenà …/filebeat_8.19.4_amd64.deb …
Rozbaluje se filebeat (8.19.4) přes (8.19.3) …
Připravuje se nahrazenà …/gitlab-ce_18.4.0-ce.0_amd64.deb …
Rozbaluje se gitlab-ce (18.4.0-ce.0) přes (18.3.1-ce.0) …
Nastavuje se balĂk gitlab-ce (18.4.0-ce.0) …
Checking PostgreSQL executables:[2025-09-19T07:57:49+02:00] INFO: Started Cinc Zero at chefzero://localhost:1 with repository at /opt/gitlab/embedded (One version per cookbook)
Cinc Client, version 18.3.0
Patents: https://www.chef.io/patents
Infra Phase starting
[2025-09-19T07:57:49+02:00] INFO: *** Cinc Client 18.3.0 ***
[2025-09-19T07:57:49+02:00] INFO: Platform: x86_64-linux
[2025-09-19T07:57:49+02:00] INFO: Cinc-client pid: 14949
[2025-09-19T07:57:50+02:00] INFO: Setting the run_list to ["recipe[gitlab::config]", "recipe[postgresql::bin]"] from CLI options
[2025-09-19T07:57:50+02:00] INFO: Run List is [recipe[gitlab::config], recipe[postgresql::bin]]
[2025-09-19T07:57:50+02:00] INFO: Run List expands to [gitlab::config, postgresql::bin]
[2025-09-19T07:57:50+02:00] INFO: Starting Cinc Client Run for eternity.srv.zajezdy.cz
[2025-09-19T07:57:50+02:00] INFO: Running start handlers
[2025-09-19T07:57:50+02:00] INFO: Start handlers complete.
Resolving cookbooks for run list: ["gitlab::config", "postgresql::bin"]
[2025-09-19T07:57:51+02:00] INFO: Loading cookbooks [gitlab@0.0.1, postgresql@0.1.0, package@0.1.0, logrotate@0.1.0, redis@0.1.0, monitoring@0.1.0, registry@0.1.0, mattermost@0.1.0, consul@0.1.0, gitaly@0.1.0, praefect@0.1.0, gitlab-kas@0
.1.0, gitlab-pages@0.1.0, letsencrypt@0.1.0, nginx@0.1.0, runit@5.1.7, acme@4.1.6, crond@0.1.0]
[2025-09-19T07:57:51+02:00] INFO: Removing cookbooks/gitlab-base/metadata.rb from the cache; its cookbook is no longer needed on this client.
[2025-09-19T07:57:51+02:00] INFO: Removing cookbooks/gitlab-base/recipes/default.rb from the cache; its cookbook is no longer needed on this client.
[2025-09-19T07:57:51+02:00] INFO: Removing cookbooks/gitlab/recipes/config.rb from the cache; its is no longer in the cookbook manifest.
[2025-09-19T07:57:51+02:00] INFO: Removing cookbooks/gitlab/recipes/users.rb from the cache; its is no longer in the cookbook manifest.
[2025-09-19T07:57:51+02:00] INFO: Removing cookbooks/gitlab/recipes/web-server.rb from the cache; its is no longer in the cookbook manifest.
[2025-09-19T07:57:51+02:00] INFO: Removing cookbooks/gitlab/templates/default/gitconfig.erb from the cache; its is no longer in the cookbook manifest.
[2025-09-19T07:57:51+02:00] INFO: Removing cookbooks/gitlab/templates/default/gitlab-backup-cli-config.yml.erb from the cache; its is no longer in the cookbook manifest.
Synchronizing cookbooks:
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitlab/templates/default/gitlab-backup-context.yml.erb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitlab/templates/default/gitlab.yml.erb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitlab/templates/default/puma.rb.erb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitlab/recipes/gitlab-backup-cli_disable.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitlab/recipes/letsencrypt_renew.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitlab/recipes/gitlab-healthcheck.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitlab/recipes/show_config.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitlab/recipes/gitlab-backup-cli.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitlab/recipes/remove_accounts.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitlab/recipes/default.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitlab/recipes/gitlab-rails.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitlab/resources/database_objects.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitlab/libraries/gitlab_rails.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/postgresql/templates/default/postgresql-runtime.conf.erb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/postgresql/attributes/default.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitlab/attributes/default.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitlab/libraries/postgresql.rb in the cache.
- postgresql (0.1.0)
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/package/recipes/users.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/package/recipes/web-server.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/package/recipes/show_config.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/package/templates/default/gitconfig.erb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/package/recipes/config.rb in the cache.
- gitlab (0.0.1)
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/package/libraries/certificate_helper.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/package/libraries/helpers/fips_helper.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/package/libraries/helpers/secrets_helper.rb in the cache.
- logrotate (0.1.0)
- package (0.1.0)
- redis (0.1.0)
- monitoring (0.1.0)
- registry (0.1.0)
- mattermost (0.1.0)
- consul (0.1.0)
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitaly/libraries/gitaly.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitlab-kas/attributes/default.rb in the cache.
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitaly/recipes/enable.rb in the cache.
- praefect (0.1.0)
- gitaly (0.1.0)
- gitlab-pages (0.1.0)
[2025-09-19T07:57:51+02:00] INFO: Storing updated cookbooks/gitlab-kas/templates/default/gitlab-kas-config.yml.erb in the cache.
- gitlab-kas (0.1.0)
- letsencrypt (0.1.0)
- nginx (0.1.0)
- runit (5.1.7)
- acme (4.1.6)
- crond (0.1.0)
Installing cookbook gem dependencies:
Compiling cookbooks...
Loading Cinc Auditor profile files:
Loading Cinc Auditor input files:
Loading Cinc Auditor waiver files:
================================================================================
Recipe Compile Error
================================================================================
Chef::Exceptions::RecipeNotFound
--------------------------------
could not find recipe config for cookbook gitlab
System Info:
------------
chef_version=18.3.0
platform=debian
platform_version=12
ruby=ruby 3.2.8 (2025-03-26 revision 13f495dc2c) [x86_64-linux]
program_name=/opt/gitlab/embedded/bin/cinc-client
executable=/opt/gitlab/embedded/bin/cinc-client
Running handlers:
[2025-09-19T07:57:52+02:00] ERROR: Running exception handlers
Running handlers complete
[2025-09-19T07:57:52+02:00] ERROR: Exception handlers complete
Infra Phase failed. 0 resources updated in 03 seconds
[2025-09-19T07:57:52+02:00] FATAL: Stacktrace dumped to /opt/gitlab/embedded/cookbooks/cache/cinc-stacktrace.out
[2025-09-19T07:57:52+02:00] FATAL: ---------------------------------------------------------------------------------------
[2025-09-19T07:57:52+02:00] FATAL: PLEASE PROVIDE THE CONTENTS OF THE stacktrace.out FILE (above) IF YOU FILE A BUG REPORT
[2025-09-19T07:57:52+02:00] FATAL: ---------------------------------------------------------------------------------------
[2025-09-19T07:57:52+02:00] FATAL: Chef::Exceptions::RecipeNotFound: could not find recipe config for cookbook gitlab
Checking PostgreSQL executables: NOT OK
Could not update PostgreSQL executables.
Shutting down all GitLab services except those needed for migrations
ok: down: alertmanager: 1s, normally up
ok: down: gitlab-exporter: 1s, normally up
ok: down: gitlab-kas: 0s, normally up
ok: down: gitlab-workhorse: 0s, normally up
ok: down: logrotate: 1s, normally up
ok: down: node-exporter: 0s, normally up
ok: down: postgres-exporter: 1s, normally up
ok: down: prometheus: 0s, normally up
ok: down: puma: 0s, normally up
ok: down: redis-exporter: 0s, normally up
ok: down: registry: 1s, normally up
ok: down: sidekiq: 0s, normally up
Ensuring the required services are running
ok: run: postgresql: (pid 1029) 244s
ok: run: redis: (pid 1038) 244s
ok: run: gitaly: (pid 1040) 244s
run: postgresql: (pid 1029) 244s; run: log: (pid 1027) 244s
run: redis: (pid 1038) 244s; run: log: (pid 1030) 244s
run: gitaly: (pid 1040) 244s; run: log: (pid 1034) 244s
# dpkg -l | grep gitlab
ii gitlab-ce 18.4.0-ce.0 amd64 GitLab Community Edition (including NGINX, Postgres, Redis)
But upgrade is done, after this error. Gitlab running normaly.
Thanks for help