Errno::EEXIST: File exists @ dir_s_mkdir on update

Have been trying to do a system update on CentOS using the Gitlab yum repo and get an error “Errno::EEXIST: File exists @ dir_s_mkdir on update” (full output shown at the bottom)

In my /etc/gitlab/etc/gitlab.rb I have:

gitlab_rails[‘manage_backup_path’] = false
gitlab_rails[‘backup_path’] = “/mnt/bkd/gitlab”

Dependencies Resolved

 Package                      Arch                      Version                             Repository                           Size
 gitlab-ee                    x86_64                    11.4.5-ee.0.el7                     gitlab_gitlab-ee                    487 M

Transaction Summary
Upgrade  1 Package

Total download size: 487 M
Is this ok [y/d/N]: y
Downloading packages:
Delta RPMs disabled because /usr/bin/applydeltarpm not installed.
gitlab-ee-11.4.5-ee.0.el7.x86_64.rpm                                                                           | 487 MB  00:01:39     
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
gitlab preinstall: Automatically backing up only the GitLab SQL database (excluding everything else!)
rake aborted!
Errno::EEXIST: File exists @ dir_s_mkdir - /mnt/bkd
/opt/gitlab/embedded/service/gitlab-rails/lib/backup/database.rb:15:in `dump'
/opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/backup.rake:99:in `block (4 levels) in <top (required)>'
/opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/backup.rake:10:in `block (3 levels) in <top (required)>'
/opt/gitlab/embedded/bin/bundle:23:in `load'
/opt/gitlab/embedded/bin/bundle:23:in `<main>'
Tasks: TOP => gitlab:backup:db:create
(See full trace by running task with --trace)
Dumping database ... 
gitlab preinstall: 
gitlab preinstall: Backup failed! If you want to skip this backup, run the following command and
gitlab preinstall: try again:
gitlab preinstall: 
gitlab preinstall:   sudo touch /etc/gitlab/skip-auto-migrations
gitlab preinstall: 
error: %pre(gitlab-ee-11.4.5-ee.0.el7.x86_64) scriptlet failed, exit status 1
Error in PREIN scriptlet in rpm package gitlab-ee-11.4.5-ee.0.el7.x86_64
gitlab-ee-11.2.3-ee.0.el7.x86_64 was supposed to be removed but is not!
  Verifying  : gitlab-ee-11.2.3-ee.0.el7.x86_64                                                                                   1/2 
  Verifying  : gitlab-ee-11.4.5-ee.0.el7.x86_64                                                                                   2/2 

  gitlab-ee.x86_64 0:11.2.3-ee.0.el7                                gitlab-ee.x86_64 0:11.4.5-ee.0.el7