Gitlab going down when backup running in background

Hi

We have a gitlab instance where backup runs every day the size of data is 72 GB and the tar file size is 36 gb after backup. during this time the application is going down.

nginx log :

2016/01/07 14:24:19 [error] 24178#0: *1898 connect() to unix:/home/git/gitlab/tmp/sockets/gitlab.socket failed (11: Resource temporarily unavailable) while connecting to upstream,

cpu usage is flucuating between 60- 400%

Can some suggest some measures to solve this downtime.

First thing to check is that you your cron is only running backup:create and not stopping any gitlab services during the backup. If that’s all fine, I’m guessing you are running into some sort of resource starvation on your server during the backup. You may want to see if you can confirm that is the case.

2 Likes