plakesr
December 13, 2016, 6:11pm
1
Hi Folks,
Can anyone help me with git push with large data sets? I am trying to push my application data (around 2 GB) to my gitlab server but getting an error. I tried both ways two push data, unfortunately, i am getting the error in both ways.
1.HTTP
Error:
fatal: The remote end hung up unexpectedly
Everything up-to-date
2.SSH
Error:
out of memory, malloc failed (tried to allocate 1048576000 bytes)
I already tried below approaches but not work for me.
git config http.postBuffer 5242880
Also
[core]
packedGitLimit = 128m
packedGitWindowSize = 128m
[pack]
deltaCacheSize = 128m
packSizeLimit = 128m
windowMemory = 128m
Please share your opinion/ solution. Thanks
@plakesr How much memory (RAM) is available on the instance?
plakesr
December 15, 2016, 4:24am
3
@markglenfletcher
Memory stats are:
Total RAM: 3952
Currently used: 957
While running git process, it consumed around 3500 and 400 MB free.
Aww…
In addition to what is listed above, I have .jpg, .png, .tgz, and .zip files set to -delta in my .gitattributes file:
*.pdf -delta
*.jpg -delta
*.tgz -delta
*.zip -delta
Also, my .gitconfig looks like this:
[user]
email = bradchesney79@gmail.com
name = BradChesney79
[merge]
keepBackup = false;
tool = p4merge
[mergetool]
prompt = false
[mergetool “p4merge”]
cmd = p4merge “$BASE” “$LOCAL” “$REMOTE” “$MERGED”
keepTemporaries = false
trustExitCode = false
keepBackup = false
[diff]
tool = p4merge
[difftool]
prompt = false
[difftool “p4merge”]
cmd = p4merge “$LOCAL” “$REMOTE”
keepTemporaries = false
trustExitCode = false
keepBackup = false
[color]
branch = auto
diff = auto
interactive = auto
status = auto
[pack]
threads = 1
deltaCacheSize = 128m
windowMemory = 50m
Still getting the malloc error on a 4096 Linode (Q: WTF is a 4096 Linode…? A: 4GB RAM Linux VPS that in this case is running Debian 9)