GitLab CE in Azure - Cannot push files

I installed GitLab CE on an Azure VM through the Marketplace. I followed the instructions here and added a custom DNS [project].eastus.cloudapp.azure.com. Everything seems to work well and I can access the web interface. When I created a new project, it gave me a URL of gitlab-ce.[longtoken].cx.internal.cloudapp.net which is not resolvable when I try to push the project files from my local machine.

I tried to update gitlab.rb to use the cloudapp.azure.com domain, but that breaks the web interface. Not sure how to proceed. Any thoughts would be greatly appreciated.