GitLab omnibus 7.9.2 redis failing

My Gitlab instance won’t start anymore since the update I did to 7.9.2 and the reboot after that.

If i tail the logs of redis I get the following:

2015-04-09_13:54:39.63692 [2946] 09 Apr 15:54:39.636 # Creating Server TCP listening socket 127.0.0.1:0: bind: Cannot assign requested address
2015-04-09_13:54:40.64135 [2953] 09 Apr 15:54:40.641 # Creating Server TCP listening socket 127.0.0.1:0: bind: Cannot assign requested address
2015-04-09_13:54:41.64567 [2954] 09 Apr 15:54:41.645 # Creating Server TCP listening socket 127.0.0.1:0: bind: Cannot assign requested address
2015-04-09_13:54:42.65127 [2984] 09 Apr 15:54:42.651 # Creating Server TCP listening socket 127.0.0.1:0: bind: Cannot assign requested address
2015-04-09_13:54:43.65722 [2985] 09 Apr 15:54:43.657 # Creating Server TCP listening socket 127.0.0.1:0: bind: Cannot assign requested address
2015-04-09_13:54:44.67056 [2987] 09 Apr 15:54:44.670 # Creating Server TCP listening socket 127.0.0.1:0: bind: Cannot assign requested address
2015-04-09_13:54:45.67414 [3004] 09 Apr 15:54:45.674 # Creating Server TCP listening socket 127.0.0.1:0: bind: Cannot assign requested address
2015-04-09_13:54:46.67720 [3006] 09 Apr 15:54:46.677 # Creating Server TCP listening socket 127.0.0.1:0: bind: Cannot assign requested address
2015-04-09_13:54:47.68270 [3007] 09 Apr 15:54:47.682 # Creating Server TCP listening socket 127.0.0.1:0: bind: Cannot assign requested address
2015-04-09_13:54:48.68887 [3008] 09 Apr 15:54:48.688 # Creating Server TCP listening socket 127.0.0.1:0: bind: Cannot assign requested address
2015-04-09_13:54:49.69409 [3019] 09 Apr 15:54:49.694 # Creating Server TCP listening socket 127.0.0.1:0: bind: Cannot assign requested address
2015-04-09_13:54:50.69983 [3029] 09 Apr 15:54:50.699 # Creating Server TCP listening socket 127.0.0.1:0: bind: Cannot assign requested address
2015-04-09_13:54:51.70310 [3037] 09 Apr 15:54:51.703 # Creating Server TCP listening socket 127.0.0.1:0: bind: Cannot assign requested address

The logs of sidekiq tell me the following:

 ==> /var/log/gitlab/sidekiq/current <==
2015-04-09_13:56:22.89804 2015-04-09T13:56:22.898Z 3581 TID-cns48 ERROR: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/fetch.rb:33:in `fetch'
2015-04-09_13:56:22.89805 2015-04-09T13:56:22.898Z 3581 TID-cns48 ERROR: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/celluloid-0.16.0/lib/celluloid/calls.rb:26:in `public_send'
2015-04-09_13:56:22.89806 2015-04-09T13:56:22.898Z 3581 TID-cns48 ERROR: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/celluloid-0.16.0/lib/celluloid/calls.rb:26:in `dispatch'
2015-04-09_13:56:22.89806 2015-04-09T13:56:22.898Z 3581 TID-cns48 ERROR: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/celluloid-0.16.0/lib/celluloid/calls.rb:122:in `dispatch'
2015-04-09_13:56:22.89807 2015-04-09T13:56:22.898Z 3581 TID-cns48 ERROR: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/celluloid-0.16.0/lib/celluloid/cell.rb:60:in `block in invoke'
2015-04-09_13:56:22.89808 2015-04-09T13:56:22.898Z 3581 TID-cns48 ERROR: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/celluloid-0.16.0/lib/celluloid/cell.rb:71:in `block in task'
2015-04-09_13:56:22.89809 2015-04-09T13:56:22.898Z 3581 TID-cns48 ERROR: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/celluloid-0.16.0/lib/celluloid/actor.rb:357:in `block in task'
2015-04-09_13:56:22.89810 2015-04-09T13:56:22.898Z 3581 TID-cns48 ERROR: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/celluloid-0.16.0/lib/celluloid/tasks.rb:57:in `block in initialize'
2015-04-09_13:56:22.89811 2015-04-09T13:56:22.898Z 3581 TID-cns48 ERROR: /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/celluloid-0.16.0/lib/celluloid/tasks/task_fiber.rb:15:in `block in create'
2015-04-09_13:56:27.89808 2015-04-09T13:56:27.898Z 3581 TID-qjio8 ERROR: heartbeat: No such file or directory - connect(2) for /var/opt/gitlab/redis/redis.socket
2015-04-09_13:56:32.89844 2015-04-09T13:56:32.898Z 3581 TID-qjio8 ERROR: heartbeat: No such file or directory - connect(2) for /var/opt/gitlab/redis/redis.socket
2015-04-09_13:56:35.05907 2015-04-09T13:56:35.059Z 3581 TID-cmrzo ERROR: No such file or directory - connect(2) for /var/opt/gitlab/redis/redis.socket

I guess something is going wrong with redis, and a unixsocket isn’t created. Does anybody know what’s going on here?

The errors were pretty fuzzy and not consistent. I ended up shutting down my server (hard-shutdown because a simple shutdown -h now didn’t work). After that it could notice the whole system was running a lot faster. I have no clue about what could have been the problem but it’s fixed :blush: