Gitlab::BackgroundMigration::EncryptCiTriggerToken::CiTrigger

Hi there,

I’m currently migrating a very old instance of GitLab (from version 12.x) to the latest GitLab. Everything seems to be fine, but my gitlab-rake gitlab:doctor:secrets RAILS_ENV=production VERBOSE=1 shows 4 errors:

I, [2023-11-09T09:52:55.082272 #96835]  INFO -- : Checking encrypted values in the database
I, [2023-11-09T09:53:01.170912 #96835]  INFO -- : - Ci::InstanceVariable failures: 0
I, [2023-11-09T09:53:01.185343 #96835]  INFO -- : - Ci::PipelineVariable failures: 0
I, [2023-11-09T09:53:01.198566 #96835]  INFO -- : - Ci::PipelineScheduleVariable failures: 0
I, [2023-11-09T09:53:01.212149 #96835]  INFO -- : - Ci::Variable failures: 0
I, [2023-11-09T09:53:01.226016 #96835]  INFO -- : - Ci::GroupVariable failures: 0
I, [2023-11-09T09:53:01.249514 #96835]  INFO -- : - Ci::Trigger failures: 1
D, [2023-11-09T09:53:01.249631 #96835] DEBUG -- :   - Ci::Trigger[5]: encrypted_token_tmp
I, [2023-11-09T09:53:01.262739 #96835]  INFO -- : - Ci::JobVariable failures: 0
I, [2023-11-09T09:53:01.271298 #96835]  INFO -- : - Gitlab::BackgroundMigration::EncryptCiTriggerToken::CiTrigger failures: 1
D, [2023-11-09T09:53:01.271385 #96835] DEBUG -- :   - Gitlab::BackgroundMigration::EncryptCiTriggerToken::CiTrigger[5]: encrypted_token_tmp
I, [2023-11-09T09:53:01.313414 #96835]  INFO -- : - ApplicationSetting failures: 0
I, [2023-11-09T09:53:01.433654 #96835]  INFO -- : - User failures: 0
I, [2023-11-09T09:53:01.445119 #96835]  INFO -- : - Clusters::Platforms::Kubernetes failures: 0
I, [2023-11-09T09:53:01.515792 #96835]  INFO -- : - Snippet failures: 0
I, [2023-11-09T09:53:01.518358 #96835]  INFO -- : - PersonalSnippet failures: 0
I, [2023-11-09T09:53:01.520296 #96835]  INFO -- : - ProjectSnippet failures: 0
I, [2023-11-09T09:53:01.647076 #96835]  INFO -- : - ProjectImportData failures: 0
I, [2023-11-09T09:53:01.691049 #96835]  INFO -- : - Integration failures: 0
I, [2023-11-09T09:53:01.695194 #96835]  INFO -- : - Integrations::AppleAppStore failures: 0
I, [2023-11-09T09:53:01.699021 #96835]  INFO -- : - Integrations::Asana failures: 0
I, [2023-11-09T09:53:01.702435 #96835]  INFO -- : - Integrations::Assembla failures: 0
I, [2023-11-09T09:53:01.706812 #96835]  INFO -- : - Integrations::BaseCi failures: 0
I, [2023-11-09T09:53:01.710098 #96835]  INFO -- : - Integrations::Bamboo failures: 0
I, [2023-11-09T09:53:01.712113 #96835]  INFO -- : - Integrations::Buildkite failures: 0
I, [2023-11-09T09:53:01.714365 #96835]  INFO -- : - Integrations::DroneCi failures: 0
I, [2023-11-09T09:53:01.716708 #96835]  INFO -- : - Integrations::Jenkins failures: 0
I, [2023-11-09T09:53:01.718731 #96835]  INFO -- : - Integrations::Teamcity failures: 0
I, [2023-11-09T09:53:01.721265 #96835]  INFO -- : - Integrations::MockCi failures: 0
I, [2023-11-09T09:53:01.724061 #96835]  INFO -- : - Integrations::BaseIssueTracker failures: 0
I, [2023-11-09T09:53:01.726362 #96835]  INFO -- : - Integrations::Bugzilla failures: 0
I, [2023-11-09T09:53:01.728329 #96835]  INFO -- : - Integrations::Clickup failures: 0
I, [2023-11-09T09:53:01.730529 #96835]  INFO -- : - Integrations::CustomIssueTracker failures: 0
I, [2023-11-09T09:53:01.732715 #96835]  INFO -- : - Integrations::Ewm failures: 0
I, [2023-11-09T09:53:01.734598 #96835]  INFO -- : - Integrations::Jira failures: 0
I, [2023-11-09T09:53:01.736748 #96835]  INFO -- : - Integrations::Redmine failures: 0
I, [2023-11-09T09:53:01.738649 #96835]  INFO -- : - Integrations::Youtrack failures: 0
I, [2023-11-09T09:53:01.740859 #96835]  INFO -- : - Integrations::Zentao failures: 0
I, [2023-11-09T09:53:01.743030 #96835]  INFO -- : - Integrations::Campfire failures: 0
I, [2023-11-09T09:53:01.745089 #96835]  INFO -- : - Integrations::BaseThirdPartyWiki failures: 0
I, [2023-11-09T09:53:01.747231 #96835]  INFO -- : - Integrations::Confluence failures: 0
I, [2023-11-09T09:53:01.749446 #96835]  INFO -- : - Integrations::Shimo failures: 0
I, [2023-11-09T09:53:01.751331 #96835]  INFO -- : - Integrations::Datadog failures: 0
I, [2023-11-09T09:53:01.754017 #96835]  INFO -- : - Integrations::BaseChatNotification failures: 0
I, [2023-11-09T09:53:01.756118 #96835]  INFO -- : - Integrations::Discord failures: 0
I, [2023-11-09T09:53:01.758225 #96835]  INFO -- : - Integrations::HangoutsChat failures: 0
I, [2023-11-09T09:53:01.760057 #96835]  INFO -- : - Integrations::Mattermost failures: 0
I, [2023-11-09T09:53:01.762193 #96835]  INFO -- : - Integrations::MicrosoftTeams failures: 0
I, [2023-11-09T09:53:01.764308 #96835]  INFO -- : - Integrations::Pumble failures: 0
I, [2023-11-09T09:53:01.766242 #96835]  INFO -- : - Integrations::BaseSlackNotification failures: 0
I, [2023-11-09T09:53:01.768367 #96835]  INFO -- : - Integrations::Slack failures: 0
I, [2023-11-09T09:53:01.770577 #96835]  INFO -- : - Integrations::GitlabSlackApplication failures: 0
I, [2023-11-09T09:53:01.772510 #96835]  INFO -- : - Integrations::Telegram failures: 0
I, [2023-11-09T09:53:01.774722 #96835]  INFO -- : - Integrations::UnifyCircuit failures: 0
I, [2023-11-09T09:53:01.776929 #96835]  INFO -- : - Integrations::WebexTeams failures: 0
I, [2023-11-09T09:53:01.778917 #96835]  INFO -- : - Integrations::EmailsOnPush failures: 0
I, [2023-11-09T09:53:01.781007 #96835]  INFO -- : - Integrations::ExternalWiki failures: 0
I, [2023-11-09T09:53:01.782898 #96835]  INFO -- : - Integrations::GooglePlay failures: 0
I, [2023-11-09T09:53:01.784930 #96835]  INFO -- : - Integrations::Harbor failures: 0
I, [2023-11-09T09:53:01.787030 #96835]  INFO -- : - Integrations::Irker failures: 0
I, [2023-11-09T09:53:01.789034 #96835]  INFO -- : - Integrations::BaseSlashCommands failures: 0
I, [2023-11-09T09:53:01.791171 #96835]  INFO -- : - Integrations::MattermostSlashCommands failures: 0
I, [2023-11-09T09:53:01.793254 #96835]  INFO -- : - Integrations::SlackSlashCommands failures: 0
I, [2023-11-09T09:53:01.795346 #96835]  INFO -- : - Integrations::Packagist failures: 0
I, [2023-11-09T09:53:01.797500 #96835]  INFO -- : - Integrations::PipelinesEmail failures: 0
I, [2023-11-09T09:53:01.799669 #96835]  INFO -- : - Integrations::Pivotaltracker failures: 0
I, [2023-11-09T09:53:01.801691 #96835]  INFO -- : - Integrations::BaseMonitoring failures: 0
I, [2023-11-09T09:53:01.803740 #96835]  INFO -- : - Integrations::Prometheus failures: 0
I, [2023-11-09T09:53:01.805820 #96835]  INFO -- : - Integrations::MockMonitoring failures: 0
I, [2023-11-09T09:53:01.807721 #96835]  INFO -- : - Integrations::Pushover failures: 0
I, [2023-11-09T09:53:01.809770 #96835]  INFO -- : - Integrations::SquashTm failures: 0
I, [2023-11-09T09:53:01.821390 #96835]  INFO -- : - AlertManagement::HttpIntegration failures: 0
I, [2023-11-09T09:53:01.831978 #96835]  INFO -- : - GrafanaIntegration failures: 0
I, [2023-11-09T09:53:01.839738 #96835]  INFO -- : - JiraConnectInstallation failures: 0
I, [2023-11-09T09:53:01.870261 #96835]  INFO -- : - PagesDomain failures: 0
I, [2023-11-09T09:53:01.879824 #96835]  INFO -- : - PagesDomainAcmeOrder failures: 0
I, [2023-11-09T09:53:01.936246 #96835]  INFO -- : - ProjectSetting failures: 0
I, [2023-11-09T09:53:01.945024 #96835]  INFO -- : - RemoteMirror failures: 0
I, [2023-11-09T09:53:01.953556 #96835]  INFO -- : - SlackIntegration failures: 0
I, [2023-11-09T09:53:01.961994 #96835]  INFO -- : - Ai::ServiceAccessToken failures: 0
I, [2023-11-09T09:53:01.970139 #96835]  INFO -- : - Alerting::ProjectAlertingSetting failures: 0
I, [2023-11-09T09:53:01.975999 #96835]  INFO -- : - Atlassian::Identity failures: 0
I, [2023-11-09T09:53:01.981879 #96835]  INFO -- : - BulkImports::Configuration failures: 0
I, [2023-11-09T09:53:02.012514 #96835]  INFO -- : - Clusters::KubernetesNamespace failures: 0
I, [2023-11-09T09:53:02.023113 #96835]  INFO -- : - ErrorTracking::ProjectErrorTrackingSetting failures: 0
I, [2023-11-09T09:53:02.030130 #96835]  INFO -- : - IncidentManagement::ProjectIncidentManagementSetting failures: 0
I, [2023-11-09T09:53:02.040220 #96835]  INFO -- : - Integrations::IssueTrackerData failures: 0
I, [2023-11-09T09:53:02.051124 #96835]  INFO -- : - Integrations::JiraTrackerData failures: 0
I, [2023-11-09T09:53:02.061533 #96835]  INFO -- : - Integrations::ZentaoTrackerData failures: 0
I, [2023-11-09T09:53:02.071533 #96835]  INFO -- : - ServiceDesk::CustomEmailCredential failures: 0
I, [2023-11-09T09:53:02.081346 #96835]  INFO -- : - ServiceDesk::CustomEmailVerification failures: 0
I, [2023-11-09T09:53:02.082994 #96835]  INFO -- : - Clusters::Integrations::Prometheus failures: 0
I, [2023-11-09T09:53:02.094320 #96835]  INFO -- : - Clusters::Providers::Aws failures: 0
I, [2023-11-09T09:53:02.104955 #96835]  INFO -- : - Clusters::Providers::Gcp failures: 0
I, [2023-11-09T09:53:02.115201 #96835]  INFO -- : - Packages::Debian::GroupDistributionKey failures: 0
I, [2023-11-09T09:53:02.124804 #96835]  INFO -- : - Packages::Debian::ProjectDistributionKey failures: 0
I, [2023-11-09T09:53:02.166887 #96835]  INFO -- : - WebHook failures: 0
I, [2023-11-09T09:53:02.170865 #96835]  INFO -- : - ProjectHook failures: 0
I, [2023-11-09T09:53:02.174601 #96835]  INFO -- : - ServiceHook failures: 0
I, [2023-11-09T09:53:02.178392 #96835]  INFO -- : - SystemHook failures: 0
I, [2023-11-09T09:53:02.182854 #96835]  INFO -- : - Gitlab::BackgroundMigration::BackfillIntegrationsEnableSslVerification::Integration failures: 0
I, [2023-11-09T09:53:02.269606 #96835]  INFO -- : - Ci::Runner failures: 0
I, [2023-11-09T09:53:03.990159 #96835]  INFO -- : - Ci::Build failures: 0
I, [2023-11-09T09:53:04.089695 #96835]  INFO -- : - Group failures: 0
I, [2023-11-09T09:53:04.106899 #96835]  INFO -- : - DeployToken failures: 2
D, [2023-11-09T09:53:04.106971 #96835] DEBUG -- :   - DeployToken[1]: token
D, [2023-11-09T09:53:04.107001 #96835] DEBUG -- :   - DeployToken[2]: token
I, [2023-11-09T09:53:04.516532 #96835]  INFO -- : - Project failures: 0
I, [2023-11-09T09:53:04.543837 #96835]  INFO -- : - Clusters::AgentToken failures: 0
I, [2023-11-09T09:53:04.566279 #96835]  INFO -- : - Operations::FeatureFlagsClient failures: 0
I, [2023-11-09T09:53:04.566437 #96835]  INFO -- : Total: 4 row(s) affected
I, [2023-11-09T09:53:04.566459 #96835]  INFO -- : Done!

Here are just error lines

I, [2023-11-09T09:53:01.249514 #96835]  INFO -- : - Ci::Trigger failures: 1
D, [2023-11-09T09:53:01.249631 #96835] DEBUG -- :   - Ci::Trigger[5]: encrypted_token_tmp
...
I, [2023-11-09T09:53:01.271298 #96835]  INFO -- : - Gitlab::BackgroundMigration::EncryptCiTriggerToken::CiTrigger failures: 1
D, [2023-11-09T09:53:01.271385 #96835] DEBUG -- :   - Gitlab::BackgroundMigration::EncryptCiTriggerToken::CiTrigger[5]: encrypted_token_tmp
...
I, [2023-11-09T09:53:04.106899 #96835]  INFO -- : - DeployToken failures: 2
D, [2023-11-09T09:53:04.106971 #96835] DEBUG -- :   - DeployToken[1]: token
D, [2023-11-09T09:53:04.107001 #96835] DEBUG -- :   - DeployToken[2]: token

Is there way how to fix them?

Hey
How exactly are you doing this migration? Is that from 1 OS to another? Something to do with encrypted token. Can be gitlab-secrets.json file related issue

Yes, it’s from Debian Jessie to Debian Bookworm, upgrade was made on older OS step by step. You have right, it is gitlab-secrets.json related. There was some other errors with Deprecate column static_object_token from users

I’ve install that via docker (it was about 46 versions!!!). During update there was some issues, but in the end it always somehow ran out to newer version.