GitLab Runner job failed with openssl::cipher::ciphererror","exception.message":"bad decrypt"

GitLab Runner job failed with openssl::cipher::ciphererror",“exception.message”:“bad decrypt”.

The runner pod is running but when try to run a job we are getting below error

*** /var/log/gitlab/production.log ***
Started GET “/contentbay/landingpage/-/jobs/8651.json” for 10.244.0.234 at 2024-04-01 17:06:17 +0000
Started GET “/contentbay/landingpage/-/jobs/8651/trace.json?state=” for 10.244.0.234 at 2024-04-01 17:06:17 +0000
Processing by Projects::JobsController#trace as JSON
Parameters: {“state”=>“”, “namespace_id”=>“contentbay”, “project_id”=>“landingpage”, “id”=>“8651”}
Processing by Projects::JobsController#show as JSON
Parameters: {“namespace_id”=>“contentbay”, “project_id”=>“landingpage”, “id”=>“8651”}
Completed 500 Internal Server Error in 98ms (ActiveRecord: 20.3ms | Elasticsearch: 0.0ms | Allocations: 24379)

OpenSSL::Cipher::CipherError (bad decrypt):

Checked below value are set

Gitlab::CurrentSettings.ci_jwt_signing_key
Rails.application.secrets.ci_jwt_signing_key

In DB application_settings encrypted_ci_jwt_signing_key value is set.

Checked no value on ci_variables, but value present in ci_group_variables.

the TLS certificate is authentic and runner is able to connect, please refer below log

Defaulted container “cb-git-gitlab-runner” out of: cb-git-gitlab-runner, configure (init)
Registration attempt 1 of 35
Runtime platform arch=amd64 os=linux pid=15 revision=3b6f852e version=14.0.0
WARNING: Running in user-mode.
WARNING: The user-mode requires you to manually start builds processing:
WARNING: $ gitlab-runner run
WARNING: Use sudo for system-mode:
WARNING: $ sudo gitlab-runner…

Registering runner… succeeded runner=bVDdsNwU
Merging configuration from template file “/configmaps/config.template.toml”
Runner registered successfully. Feel free to start it, but if it’s running already the config should be automatically reloaded!
Runtime platform arch=amd64 os=linux pid=1 revision=3b6f852e version=14.0.0
Starting multi-runner from /home/gitlab-runner/.gitlab-runner/config.toml… builds=0
WARNING: Running in user-mode.
WARNING: Use sudo for system-mode:
WARNING: $ sudo gitlab-runner…

Configuration loaded builds=0
Metrics server listening address=:9252 builds=0
[session_server].listen_address not defined, session endpoints disabled builds=0

Not able to understand or getting any clue why we are getting “openssl::cipher::ciphererror”,“exception.message”:“bad decrypt”. error.

GitLab version 14.0.1 running on OKE environment.

No recent update happens.