Deleting files in /etc/gitlab/ssl worked for me, too.
Being a Linux novice, I was searching for the location of gitlab-ctl just to find out it seems to be in the search path, so I can call it from any location.
My complete command line was:
sudo gitlab-ctl reconfigure