Various 500 errors after migration

Hello all,

After a migration from a failed server to a new server, I’m running into 500 errors on various locations, including removing an avatar from a project, and changing email notification settings in the admin panel. I’ve pasted the important part of the log below. I saw some similar topics, however when I attempted to run ApplicationSetting.current.reset_runners_registration_token! it failed with a similar error:
Traceback (most recent call last):
3: from (irb):1
2: from app/models/concerns/token_authenticatable.rb:53:in block in add_authentication_token_field' 1: from app/models/concerns/token_authenticatable_strategies/base.rb:44:in reset_token!’
OpenSSL::Cipher::CipherError ()
I’d like to get these errors resolved of course.

I’m relatively new to admining gitlab, so any assistance you guys can provide would be appreciated.

Log below:

==> /var/log/gitlab/gitaly/current <==
{“gitaly”:269,“level”:“warning”,“msg”:“forwarding signal”,“signal”:23,“time”:“2021-04-01T22:00:47Z”,“wrapper”:260}
{“gitaly”:269,“level”:“warning”,“msg”:“forwarding signal”,“signal”:23,“time”:“2021-04-01T22:00:47Z”,“wrapper”:260}

==> /var/log/gitlab/gitlab-rails/production.log <==
Started DELETE “/TheGUESSUniversalEditingSuiteandSDK/HIP_DAME/-/avatar” for 10.0.0.105 at 2021-04-01 22:00:50 +0000
Processing by Projects::AvatarsController#destroy as HTML
Parameters: {“authenticity_token”=>"[FILTERED]", “namespace_id”=>“TheGUESSUniversalEditingSuiteandSDK”, “project_id”=>“HIP_DAME”}
Completed 500 Internal Server Error in 78ms (ActiveRecord: 10.9ms | Elasticsearch: 0.0ms | Allocations: 19586)

==> /var/log/gitlab/gitlab-rails/production_json.log <==
{“method”:“DELETE”,“path”:"/TheGUESSUniversalEditingSuiteandSDK/HIP_DAME/-/avatar",“format”:“html”,“controller”:“Projects::AvatarsController”,“action”:“destroy”,“status”:500,“time”:“2021-04-01T22:00:50.984Z”,“params”:[{“key”:"_method",“value”:“delete”},{“key”:“authenticity_token”,“value”:"[FILTERED]"},{“key”:“namespace_id”,“value”:“TheGUESSUniversalEditingSuiteandSDK”},{“key”:“project_id”,“value”:“HIP_DAME”}],“remote_ip”:“10.0.0.105”,“user_id”:126,“username”:“panth”,“ua”:“Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.114 Safari/537.36”,“correlation_id”:“01F27Q83D8DXWTTRQ4V7QP2FRK”,“meta.user”:“panth”,“meta.project”:“TheGUESSUniversalEditingSuiteandSDK/HIP_DAME”,“meta.root_namespace”:“TheGUESSUniversalEditingSuiteandSDK”,“meta.caller_id”:“Projects::AvatarsController#destroy”,“meta.remote_ip”:“10.0.0.105”,“meta.feature_category”:“projects”,“redis_calls”:1,“redis_duration_s”:0.001406,“redis_read_bytes”:184,“redis_write_bytes”:880,“redis_shared_state_calls”:1,“redis_shared_state_duration_s”:0.001406,“redis_shared_state_read_bytes”:184,“redis_shared_state_write_bytes”:880,“db_count”:15,“db_write_count”:1,“db_cached_count”:1,“cpu_s”:0.11,“exception.class”:“OpenSSL::Cipher::CipherError”,“exception.message”:"",“exception.backtrace”:[“lib/gitlab/crypto_helper.rb:27:in aes256_gcm_decrypt'","app/models/concerns/token_authenticatable_strategies/encrypted.rb:45:in get_token’”,“app/models/concerns/token_authenticatable_strategies/base.rb:32:in ensure_token'","app/models/concerns/token_authenticatable_strategies/encrypted.rb:32:in ensure_token’”,“app/models/concerns/token_authenticatable.rb:43:in block in add_authentication_token_field'","app/controllers/projects/avatars_controller.rb:20:in destroy’”,“app/controllers/application_controller.rb:482:in set_current_admin'","lib/gitlab/session.rb:11:in with_session’”,“app/controllers/application_controller.rb:473:in set_session_storage'","lib/gitlab/i18n.rb:73:in with_locale’”,“lib/gitlab/i18n.rb:79:in with_user_locale'","app/controllers/application_controller.rb:467:in set_locale’”,“lib/gitlab/error_tracking.rb:52:in with_context'","app/controllers/application_controller.rb:532:in sentry_context’”,“app/controllers/application_controller.rb:460:in block in set_current_context'","lib/gitlab/application_context.rb:56:in block in use’”,“lib/gitlab/application_context.rb:56:in use'","lib/gitlab/application_context.rb:22:in with_context’”,“app/controllers/application_controller.rb:451:in set_current_context'","lib/gitlab/request_profiler/middleware.rb:17:in call’”,“lib/gitlab/jira/middleware.rb:19:in call'","lib/gitlab/middleware/go.rb:20:in call’”,“lib/gitlab/etag_caching/middleware.rb:21:in call'","lib/gitlab/middleware/multipart.rb:172:in call’”,“lib/gitlab/middleware/read_only/controller.rb:50:in call'","lib/gitlab/middleware/read_only.rb:18:in call’”,“lib/gitlab/middleware/same_site_cookies.rb:27:in call'","lib/gitlab/middleware/handle_malformed_strings.rb:21:in call’”,“lib/gitlab/middleware/basic_health_check.rb:25:in call'","lib/gitlab/middleware/handle_ip_spoof_attack_error.rb:25:in call’”,“lib/gitlab/middleware/request_context.rb:23:in call'","config/initializers/fix_local_cache_middleware.rb:9:in call’”,“lib/gitlab/metrics/requests_rack_middleware.rb:76:in call'","lib/gitlab/middleware/release_env.rb:12:in call’”],“db_duration_s”:0.01091,“view_duration_s”:0.0,“duration_s”:0.07807}

==> /var/log/gitlab/gitlab-rails/production.log <==

OpenSSL::Cipher::CipherError ():

lib/gitlab/crypto_helper.rb:27:in aes256_gcm_decrypt' app/models/concerns/token_authenticatable_strategies/encrypted.rb:45:in get_token’
app/models/concerns/token_authenticatable_strategies/base.rb:32:in ensure_token' app/models/concerns/token_authenticatable_strategies/encrypted.rb:32:in ensure_token’
app/models/concerns/token_authenticatable.rb:43:in block in add_authentication_token_field' app/controllers/projects/avatars_controller.rb:20:in destroy’
app/controllers/application_controller.rb:482:in set_current_admin' lib/gitlab/session.rb:11:in with_session’
app/controllers/application_controller.rb:473:in set_session_storage' lib/gitlab/i18n.rb:73:in with_locale’
lib/gitlab/i18n.rb:79:in with_user_locale' app/controllers/application_controller.rb:467:in set_locale’
lib/gitlab/error_tracking.rb:52:in with_context' app/controllers/application_controller.rb:532:in sentry_context’
app/controllers/application_controller.rb:460:in block in set_current_context' lib/gitlab/application_context.rb:56:in block in use’
lib/gitlab/application_context.rb:56:in use' lib/gitlab/application_context.rb:22:in with_context’
app/controllers/application_controller.rb:451:in set_current_context' lib/gitlab/request_profiler/middleware.rb:17:in call’
lib/gitlab/jira/middleware.rb:19:in call' lib/gitlab/middleware/go.rb:20:in call’
lib/gitlab/etag_caching/middleware.rb:21:in call' lib/gitlab/middleware/multipart.rb:172:in call’
lib/gitlab/middleware/read_only/controller.rb:50:in call' lib/gitlab/middleware/read_only.rb:18:in call’
lib/gitlab/middleware/same_site_cookies.rb:27:in call' lib/gitlab/middleware/handle_malformed_strings.rb:21:in call’
lib/gitlab/middleware/basic_health_check.rb:25:in call' lib/gitlab/middleware/handle_ip_spoof_attack_error.rb:25:in call’
lib/gitlab/middleware/request_context.rb:23:in call' config/initializers/fix_local_cache_middleware.rb:9:in call’
lib/gitlab/metrics/requests_rack_middleware.rb:76:in call' lib/gitlab/middleware/release_env.rb:12:in call’