Getting GitLab to work on ubuntu server alongside PHP hosted sites

I have an ubuntu server where GitLab is successfully working on mydomain.com/gitlab. My issue now is I have installed both Apache2 and PHP and have a info.php file in /var/www/html/info.php. However when I go to mydomain.com/info.php I am faced with a 404 page from gitlab. The same thing happens when I place it in a test folder and try mydomain.com/test/info.php.

I have followed the instructions in https://docs.gitlab.com/omnibus/settings/nginx.html#using-a-non-bundled-web-server to disable Nginx and created a gitlab.conf file in /etc/apache2/sites-available. Next, this is my .conf file for the DocumentRoot /var/www/html.

 <VirtualHost *:80>
    ServerAdmin admin@mydomain.com
    DocumentRoot /var/www/html/
    ServerName www.mydomain.com
    ServerAlias mydomain.com
    ErrorLog /var/log/httpd/mydomain.com/error.log
    CustomLog /var/log/httpd/mydomain.com/access.log common



<Directory "/var/www/html/">
    Options Indexes FollowSymLinks Includes MultiViews ExecCGI
    AllowOverride All

    Order allow,deny
    Allow from all
</Directory>

</VirtualHost>

Hopefully someone can help me getting this up and running