Improve Gitlab performance?

I think this is backwards from what I see most questions are when talking performance. I’m hitting issues when running multiple jenkins jobs(about 50-200 simultaneous clones, ssh and https) and I keep getting timeouts. I use the default of 10minutes. Largest repo is ~1g. Gitlab version is 10.3.2, CE

So I beefed up the server. I gave my server 16 cpu’s and 32gb of ram. 10G network connection. I’ve increased the unicorn workers to use more cpu’s and that has helped. But I have noticed gitlab still uses about 8G of ram. Is there a way to tell it to use more? How can I increase performance given the extra hardware? I don’t know enough about postgres performance tuning to know what to do there. Can I just increase shard size by itself? Something else?