Microsoft Azure Instance Stalls with GitLab

I have configured GitLab on recommended Azure VM which has Linux OS run by 1 core and 3.5 GB RAM VM. When I configured it worked well with all my push and pull requests going through but when i opened the same to my team I see that the it responds intermittently and stalls leading to request time out error. Do you have any recommendation on the observation.