Git allways asking for password instead using ssh key on my gitlab server

Hi,

i put my ssh key to my gitlab settings and when i type this command:
> ssh -T git@git.mygitlabserver.de

i got:
Welcome to Gitlab @chrobaks

So i think, ssh is working fine, but if try to push or pull, git always asking for my password instead using my ssh key.
I’m using a passphrase when i was generated the ssh key.

Here my config file

Host git.mygitlabserver.de
PubkeyAuthentication yes
IdentityFile ~/.ssh/id_rsa

Any idea, what i can do, that not always type in my password?