Certs were created automatically from GitLab EE 10.5.1, but they cannot seem to be used on a macOS host. Do you have any details on how to download and apply the root certs when registering the runner on macOS?
I fixed this by placing the cer into ~/.gitlab-runner/certs/