Automatically push to mirror repo behind ssh

I’m trying to figure out how to set up automatic pushing to my repository which is accessible only via ssh. I have gitlab installed on Ubuntu 16 and can successfully “git ls-remote” from the ubuntu user to the remote repository, however I can’t get gitlab to communicate to it. I assume I need to set up a public key for one of the gitlab users? Anyone have any experience with this? Thanks!