On Gitlab HA node: Gitaly unable to connect to all address

I am trying to build GitLab HA environment. I have Gitlab on 2 nodes and gitaly on 2 with Load Balancer. and External PostgreSQL.

I could access API from Gitaly to Gitlab.

sudo /opt/gitlab/embedded/bin/gitaly-hooks check /var/opt/gitlab/gitaly/config.toml
Checking GitLab API access: OK
GitLab version: 13.8.1
GitLab revision:
GitLab Api version: v4
Redis reachable for GitLab: true

but sudo gitlab-rake gitlab:gitaly:check fails with beloow error.

Gitaly: … default … FAIL: 14:failed to connect to all addresses. debug_error_string:{“created”:"@1612860468.255943520",“description”:“Failed to pick subchannel”,“file”:“src/core/ext/filters/client_channel/client_channel.cc”,“file_line”:3952,“referenced_errors”:[{“created”:"@1612860468.255938811",“description”:“failed to connect to all addresses”,“file”:“src/core/ext/filters/client_channel/lb_policy/pick_first/pick_first.cc”,“file_line”:394,“grpc_status”:14}]}

gitlab.rb file configuration for Gitaly on Gitlab Node:

gitaly[‘auth_token’] = ‘gitalysecret’
gitlab_shell[‘secret_token’] = ‘shellsecret’

‘default’ => { ‘gitaly_address’ => ‘tcp://ech-10-157-152-208.test.int:8075’ },
‘storage1’ => { ‘gitaly_address’ => ‘tcp://ech-10-157-152-208.test.int:8075’ },
‘storage2’ => { ‘gitaly_address’ => ‘tcp://ech-10-157-152-209.test.int:8075’,

gitaly[‘enable’] = false

Am I missing anything in the configuration?


I am facing the same error. Did you get any solution for this ?