Multiple projects start failing the repository check on the Gitlab filesystem

I’m encountering a strange behavior in a Gitlab CE instance using the repository check feature. Since a few weeks more and more project on the instance start to fail the repository check. Here is the example output of one git repository:

$ sudo /opt/gitlab/embedded/bin/git -C /app/gitlab/data/git-data/repositories/@hashed/0b/3f/0b3fe555ae8bd943feae4fb5e9ee5bebc608cafec26b75fe281b245ba635edc8.git fsck
Checking object directories: 100% (256/256), done.
Checking objects: 100% (26187/26187), done.
dangling tag 573cd3296e92bef6aa0954f8fa80d6c67707b515
dangling tag 5449a4d949d939ab9db7540a09fdcf78416d15df
dangling tag 8949ae669fe7465317b74755f35c4b675ae419f4
dangling commit 0356aba4e462713b7f716c0705e2f8fa8b4b9bfe
dangling tag 4fd4207e16d0e9fe2347cb71570bdbeed586e97d
Verifying commits in commit graph: 100% (50/50), done.
Verifying commits in commit graph: 100% (288/288), done.
error: Could not read 01f41cf98d84f8d24576f13cab2c8f403b1c80e0
failed to parse commit 01f41cf98d84f8d24576f13cab2c8f403b1c80e0 from object database for commit-graph
error: Could not read 02962c889fde71df5be8d650765bfe4f48726a22
failed to parse commit 02962c889fde71df5be8d650765bfe4f48726a22 from object database for commit-graph
error: Could not read 06d4788dd990590228fdc578bf86ad8c7f5f2700
failed to parse commit 06d4788dd990590228fdc578bf86ad8c7f5f2700 from object database for commit-graph
error: Could not read 06f10dc4070a946204cc8302bca259faee766624
failed to parse commit 06f10dc4070a946204cc8302bca259faee766624 from object database for commit-graph
error: Could not read 07eb4662b811e176a304d9b0c20dad5338f573e9
failed to parse commit 07eb4662b811e176a304d9b0c20dad5338f573e9 from object database for commit-graph
error: Could not read 0d0501d06e181527b66f11595a34c08fdca39ec0
failed to parse commit 0d0501d06e181527b66f11595a34c08fdca39ec0 from object database for commit-graph
error: Could not read 0d8567c6a0c392382c13a3d4c44ca74eebe8f05f
failed to parse commit 0d8567c6a0c392382c13a3d4c44ca74eebe8f05f from object database for commit-graph
error: Could not read 0dc12da66830cadcc0718ac68ae46499743ded56
failed to parse commit 0dc12da66830cadcc0718ac68ae46499743ded56 from object database for commit-graph
error: Could not read 0f30556ef990c0b7fc04cca4611d476ab28681d3
failed to parse commit 0f30556ef990c0b7fc04cca4611d476ab28681d3 from object database for commit-graph
error: Could not read 11ed69e8004f2658eaaba279116de59be20c29a5
failed to parse commit 11ed69e8004f2658eaaba279116de59be20c29a5 from object database for commit-graph
error: Could not read 122ac0d572812359dbaed91301a5b9fe1aabb375
failed to parse commit 122ac0d572812359dbaed91301a5b9fe1aabb375 from object database for commit-graph
error: Could not read 159e6e373f9b485db840e03c1f421a4c7d207f63
failed to parse commit 159e6e373f9b485db840e03c1f421a4c7d207f63 from object database for commit-graph
error: Could not read 18ff86b0e23bbfe4a0dcf5ddc1ed7f5c48eaa44b
failed to parse commit 18ff86b0e23bbfe4a0dcf5ddc1ed7f5c48eaa44b from object database for commit-graph
error: Could not read 1f90502853e1c47bd25173c1ec9bc61e7fb42580
failed to parse commit 1f90502853e1c47bd25173c1ec9bc61e7fb42580 from object database for commit-graph
error: Could not read 1fd1b547b3d1d21ce6035858c6175c0378913c67
failed to parse commit 1fd1b547b3d1d21ce6035858c6175c0378913c67 from object database for commit-graph
error: Could not read 28b9a607fb5bcd0b27a66e7a164be48d7ab5ceab
failed to parse commit 28b9a607fb5bcd0b27a66e7a164be48d7ab5ceab from object database for commit-graph
error: Could not read 2b7ea7fc209d26ee4216e2ba34cf107533480d97
failed to parse commit 2b7ea7fc209d26ee4216e2ba34cf107533480d97 from object database for commit-graph
error: Could not read 2d0fd83ba81a510f8c7d2556f896a8329149437f
failed to parse commit 2d0fd83ba81a510f8c7d2556f896a8329149437f from object database for commit-graph
error: Could not read 31c4de1597d4c7861b5cd423e872cf6fb31591f9
failed to parse commit 31c4de1597d4c7861b5cd423e872cf6fb31591f9 from object database for commit-graph
error: Could not read 36548ee0566dabc3f295483b5b6ece8bb1b1bbf4
failed to parse commit 36548ee0566dabc3f295483b5b6ece8bb1b1bbf4 from object database for commit-graph
error: Could not read 38373fed0ce70fa71cc19601c3900602fcb7b75e
failed to parse commit 38373fed0ce70fa71cc19601c3900602fcb7b75e from object database for commit-graph
error: Could not read 39420451307c35ab8a53ef89fca429a5d7e42afb
failed to parse commit 39420451307c35ab8a53ef89fca429a5d7e42afb from object database for commit-graph
error: Could not read 438272ba85f606e53577011c6564f5850128c25b
failed to parse commit 438272ba85f606e53577011c6564f5850128c25b from object database for commit-graph
error: Could not read 440721096ad5c4febd60853bcc5adc23e5ab1062
failed to parse commit 440721096ad5c4febd60853bcc5adc23e5ab1062 from object database for commit-graph
error: Could not read 4bc70a3b215d721f93a05f217daec748f72162f9
failed to parse commit 4bc70a3b215d721f93a05f217daec748f72162f9 from object database for commit-graph
error: Could not read 4de393e33d05cc3f741e88ed7814f1f64718980d
failed to parse commit 4de393e33d05cc3f741e88ed7814f1f64718980d from object database for commit-graph
error: Could not read 4ff108460a432d5f40e87b4c0d32042ce0617bdf
failed to parse commit 4ff108460a432d5f40e87b4c0d32042ce0617bdf from object database for commit-graph
error: Could not read 539fe102f3fbf58f1c0f6eee728d5d0a3c747e1b
failed to parse commit 539fe102f3fbf58f1c0f6eee728d5d0a3c747e1b from object database for commit-graph
error: Could not read 551f629d518efd245a6a57cd7a3d43873ec448b7
failed to parse commit 551f629d518efd245a6a57cd7a3d43873ec448b7 from object database for commit-graph
error: Could not read 56af0beda685deb206ad8d1c77bab848a14c9386
failed to parse commit 56af0beda685deb206ad8d1c77bab848a14c9386 from object database for commit-graph
error: Could not read 5a8d9991d8814e552310960898020fafa41d8cc5
failed to parse commit 5a8d9991d8814e552310960898020fafa41d8cc5 from object database for commit-graph
error: Could not read 5d87c1067265c71538706c6e84f63dfbd474a58b
failed to parse commit 5d87c1067265c71538706c6e84f63dfbd474a58b from object database for commit-graph
error: Could not read 5e21e91f52cbaaed4e457a93cfb6e55fd109ea6e
failed to parse commit 5e21e91f52cbaaed4e457a93cfb6e55fd109ea6e from object database for commit-graph
error: Could not read 5e65df10b1e877cffbcc17d2c93723bd813052c1
failed to parse commit 5e65df10b1e877cffbcc17d2c93723bd813052c1 from object database for commit-graph
error: Could not read 5e7b29f57e2514f5708849745794adcf544d60d2
failed to parse commit 5e7b29f57e2514f5708849745794adcf544d60d2 from object database for commit-graph
error: Could not read 5ff5da76c3287b41cd08b8d7a359e8f19fda1d97
failed to parse commit 5ff5da76c3287b41cd08b8d7a359e8f19fda1d97 from object database for commit-graph
error: Could not read 624f934520206c492b7937ea292b74a32d54e50c
failed to parse commit 624f934520206c492b7937ea292b74a32d54e50c from object database for commit-graph
error: Could not read 62b4a9ebbdcaed5a0996527c1086c1321d466175
failed to parse commit 62b4a9ebbdcaed5a0996527c1086c1321d466175 from object database for commit-graph
error: Could not read 63cace894cfce3be9b5b6d8b8afbf6ed2f1ce3bc
failed to parse commit 63cace894cfce3be9b5b6d8b8afbf6ed2f1ce3bc from object database for commit-graph
error: Could not read 644c9ace7a5d1286e8aae7b260757988ceffd48e
failed to parse commit 644c9ace7a5d1286e8aae7b260757988ceffd48e from object database for commit-graph
error: Could not read 65081e22358f1ee7ddf4186994a442e42c96aa56
failed to parse commit 65081e22358f1ee7ddf4186994a442e42c96aa56 from object database for commit-graph
error: Could not read 6631a1f109d4f9f2ec8b8ad35f179b155e9a4b20
failed to parse commit 6631a1f109d4f9f2ec8b8ad35f179b155e9a4b20 from object database for commit-graph
error: Could not read 6784f6f67eeb1c9f6d9db70a259db440397d40e5
failed to parse commit 6784f6f67eeb1c9f6d9db70a259db440397d40e5 from object database for commit-graph
error: Could not read 6906c66fc9f5a64cefc63a4991596d69c72ff087
failed to parse commit 6906c66fc9f5a64cefc63a4991596d69c72ff087 from object database for commit-graph
error: Could not read 6c233666b7b1f07c44168e71d6dea40b7c03e4f8
failed to parse commit 6c233666b7b1f07c44168e71d6dea40b7c03e4f8 from object database for commit-graph
error: Could not read 7581abf033b74ad14c7884df79035e628a125b78
failed to parse commit 7581abf033b74ad14c7884df79035e628a125b78 from object database for commit-graph
error: Could not read 761501eb83882ada2c19a44954b73a5f77f45160
failed to parse commit 761501eb83882ada2c19a44954b73a5f77f45160 from object database for commit-graph
error: Could not read 7786b76af227d18de0cf304c0f628ffbb4bb138d
failed to parse commit 7786b76af227d18de0cf304c0f628ffbb4bb138d from object database for commit-graph
error: Could not read 78c8ab401779db5214734634d51d6c34898b1b45
failed to parse commit 78c8ab401779db5214734634d51d6c34898b1b45 from object database for commit-graph
error: Could not read 78d85154fde7dd513eff9c3952e8b7ad047e6945
failed to parse commit 78d85154fde7dd513eff9c3952e8b7ad047e6945 from object database for commit-graph
error: Could not read 7afc584d67253d4a8b0e0f5eea48c07ac55bd770
failed to parse commit 7afc584d67253d4a8b0e0f5eea48c07ac55bd770 from object database for commit-graph
error: Could not read 7c4e6caeef16ebca044d268b6fede8742527fb1f
failed to parse commit 7c4e6caeef16ebca044d268b6fede8742527fb1f from object database for commit-graph
error: Could not read 7cd7a990629ab37321a4fe3d39e88a29afdbbf51
failed to parse commit 7cd7a990629ab37321a4fe3d39e88a29afdbbf51 from object database for commit-graph
error: Could not read 7f6e69a988f3c970d5837001ac99a55ee8c49965
failed to parse commit 7f6e69a988f3c970d5837001ac99a55ee8c49965 from object database for commit-graph
error: Could not read 8084610217ae39d4a726a8f4a8ba70bd22f28a33
failed to parse commit 8084610217ae39d4a726a8f4a8ba70bd22f28a33 from object database for commit-graph
error: Could not read 81d9ebb815b84a78409788932ada5de4be572d71
failed to parse commit 81d9ebb815b84a78409788932ada5de4be572d71 from object database for commit-graph
error: Could not read 8598b65fe9e7a7520343b867fee497ede5eb759a
failed to parse commit 8598b65fe9e7a7520343b867fee497ede5eb759a from object database for commit-graph
error: Could not read 85bb0c9545e25bf611ad51ae4e15a4b6492782a5
failed to parse commit 85bb0c9545e25bf611ad51ae4e15a4b6492782a5 from object database for commit-graph
error: Could not read 875f02a64395e9442da4b3940b0f2ec3b007ad6e
failed to parse commit 875f02a64395e9442da4b3940b0f2ec3b007ad6e from object database for commit-graph
error: Could not read 87ea6c088df0b26df97b428560b6e48f27eb23d2
failed to parse commit 87ea6c088df0b26df97b428560b6e48f27eb23d2 from object database for commit-graph
error: Could not read 89d49882ca9d4b15ed8b0e0fd6c776e33f25dc0e
failed to parse commit 89d49882ca9d4b15ed8b0e0fd6c776e33f25dc0e from object database for commit-graph
error: Could not read 8b3d95d4beafc024430583696d75c211c5057cec
failed to parse commit 8b3d95d4beafc024430583696d75c211c5057cec from object database for commit-graph
error: Could not read 8c523583ba054a2965bfc3c860ed9760e1789dbe
failed to parse commit 8c523583ba054a2965bfc3c860ed9760e1789dbe from object database for commit-graph
error: Could not read 8cee685c6a1ba2cdccdab93b8791fd96fed4036a
failed to parse commit 8cee685c6a1ba2cdccdab93b8791fd96fed4036a from object database for commit-graph
error: Could not read 8ed92d9ff5d489e7772582555f36f11fd5242325
failed to parse commit 8ed92d9ff5d489e7772582555f36f11fd5242325 from object database for commit-graph
error: Could not read 8ed99e757fa7096b2497b03d5152b2aa8284506f
failed to parse commit 8ed99e757fa7096b2497b03d5152b2aa8284506f from object database for commit-graph
error: Could not read 933caf90c1fda0a384ea1eb9f207a7245678c22d
failed to parse commit 933caf90c1fda0a384ea1eb9f207a7245678c22d from object database for commit-graph
error: Could not read 9344ee983bc57c491646a4150860598d2b9b3b2c
failed to parse commit 9344ee983bc57c491646a4150860598d2b9b3b2c from object database for commit-graph
error: Could not read 94e20adc952f95aa348569bea95aacd654953014
failed to parse commit 94e20adc952f95aa348569bea95aacd654953014 from object database for commit-graph
error: Could not read 955fc18bab0560c2386fd0dbc72178203a711dec
failed to parse commit 955fc18bab0560c2386fd0dbc72178203a711dec from object database for commit-graph
error: Could not read 962583b458c3bced4c8936b67829d36d1514861f
failed to parse commit 962583b458c3bced4c8936b67829d36d1514861f from object database for commit-graph
error: Could not read 9974108845f702bf5f5ade33bce93987a5cd40cc
failed to parse commit 9974108845f702bf5f5ade33bce93987a5cd40cc from object database for commit-graph
error: Could not read 9b2585e2de8e72ef0bb6cb22c2aa77b09fe0475a
failed to parse commit 9b2585e2de8e72ef0bb6cb22c2aa77b09fe0475a from object database for commit-graph
error: Could not read a00a1efbc08778bb4f0a16c26fadce755cf70563
failed to parse commit a00a1efbc08778bb4f0a16c26fadce755cf70563 from object database for commit-graph
error: Could not read a019503ce3d7f7878d96da76d417f7fb7db201ca
failed to parse commit a019503ce3d7f7878d96da76d417f7fb7db201ca from object database for commit-graph
error: Could not read a6bb9bc5372b1e7e40696390d0dfab757add9fd4
failed to parse commit a6bb9bc5372b1e7e40696390d0dfab757add9fd4 from object database for commit-graph
error: Could not read a938a62e8947dfb5853ef8d86add83bd4ab62a60
failed to parse commit a938a62e8947dfb5853ef8d86add83bd4ab62a60 from object database for commit-graph
error: Could not read abed0d58d58d684b24a736f32a0d73cfada559d7
failed to parse commit abed0d58d58d684b24a736f32a0d73cfada559d7 from object database for commit-graph
error: Could not read aefec15695925a4d72eaf7dda8d22a96994cb99d
failed to parse commit aefec15695925a4d72eaf7dda8d22a96994cb99d from object database for commit-graph
error: Could not read af9b5906bd0322f33892a37d635b81ff87d03cf1
failed to parse commit af9b5906bd0322f33892a37d635b81ff87d03cf1 from object database for commit-graph
error: Could not read b023fe13d7b43ece7cfae162422d542c96c2651d
failed to parse commit b023fe13d7b43ece7cfae162422d542c96c2651d from object database for commit-graph
error: Could not read b1948480f52bc139a03a80099fa46463a64ab569
failed to parse commit b1948480f52bc139a03a80099fa46463a64ab569 from object database for commit-graph
error: Could not read b1b733c819bd595512793692fe9c84ae79f4f3d0
failed to parse commit b1b733c819bd595512793692fe9c84ae79f4f3d0 from object database for commit-graph
error: Could not read b5a55ad1ec00c50bc13c860a879004c77fa940c4
failed to parse commit b5a55ad1ec00c50bc13c860a879004c77fa940c4 from object database for commit-graph
error: Could not read ba57f12cecf368d72cd58507d7d7cf3e491a5536
failed to parse commit ba57f12cecf368d72cd58507d7d7cf3e491a5536 from object database for commit-graph
error: Could not read bafc75e748bf8862ca37a618eee1dbc86048adb0
failed to parse commit bafc75e748bf8862ca37a618eee1dbc86048adb0 from object database for commit-graph
error: Could not read bbaec7f557a32998cda66e276bd414ee3a728b14
failed to parse commit bbaec7f557a32998cda66e276bd414ee3a728b14 from object database for commit-graph
error: Could not read bd334236ac903403ae2ece945b5a0fd36d6c00c7
failed to parse commit bd334236ac903403ae2ece945b5a0fd36d6c00c7 from object database for commit-graph
error: Could not read bec3b385b53baf6a3869bcb373f07de4420ac8f2
failed to parse commit bec3b385b53baf6a3869bcb373f07de4420ac8f2 from object database for commit-graph
error: Could not read bf154c689150abf8d38789c9464346526192450e
failed to parse commit bf154c689150abf8d38789c9464346526192450e from object database for commit-graph
error: Could not read c2b649b562cb6f0037b12094dcdce91e2aafc71a
failed to parse commit c2b649b562cb6f0037b12094dcdce91e2aafc71a from object database for commit-graph
error: Could not read c62cc4718a22cbd440d8df8347004da4f9c0757a
failed to parse commit c62cc4718a22cbd440d8df8347004da4f9c0757a from object database for commit-graph
error: Could not read c6c8462318caf044d075227c4f3c1e39a315fc09
failed to parse commit c6c8462318caf044d075227c4f3c1e39a315fc09 from object database for commit-graph
error: Could not read c7aadc4a4356d06610db44ce6f79aae1a1f8296b
failed to parse commit c7aadc4a4356d06610db44ce6f79aae1a1f8296b from object database for commit-graph
error: Could not read c83860576dc66ba7b4c59cd091e3bc667bbe2c45
failed to parse commit c83860576dc66ba7b4c59cd091e3bc667bbe2c45 from object database for commit-graph
error: Could not read cc38220d600578b79a34c10d11d7a330e9d7cdf3
failed to parse commit cc38220d600578b79a34c10d11d7a330e9d7cdf3 from object database for commit-graph
error: Could not read cd5c1e036248fde501f443dc29743add52065109
failed to parse commit cd5c1e036248fde501f443dc29743add52065109 from object database for commit-graph
error: Could not read d030b723ff9ce964597157147d12bd76fa46dd3b
failed to parse commit d030b723ff9ce964597157147d12bd76fa46dd3b from object database for commit-graph
error: Could not read d0933b2a5c655ade2116be784670d82d687a12a3
failed to parse commit d0933b2a5c655ade2116be784670d82d687a12a3 from object database for commit-graph
error: Could not read d25a6cf5a9ef49c02b4df17b03c843b30f5f9293
failed to parse commit d25a6cf5a9ef49c02b4df17b03c843b30f5f9293 from object database for commit-graph
error: Could not read d28faa869a61ff155f0ff5ab42af5bd588b812d0
failed to parse commit d28faa869a61ff155f0ff5ab42af5bd588b812d0 from object database for commit-graph
error: Could not read d381ae98abbca7b10713b1f4d26ce57acac602b6
failed to parse commit d381ae98abbca7b10713b1f4d26ce57acac602b6 from object database for commit-graph
error: Could not read d64e8593ecc150c03c7e887d7a7b27e2a5285bcd
failed to parse commit d64e8593ecc150c03c7e887d7a7b27e2a5285bcd from object database for commit-graph
error: Could not read d863c5bfdeee5b2e3d24ee7145755e7f46f5d311
failed to parse commit d863c5bfdeee5b2e3d24ee7145755e7f46f5d311 from object database for commit-graph
error: Could not read d8db4b8bb13095623edafdff2453f49880a69756
failed to parse commit d8db4b8bb13095623edafdff2453f49880a69756 from object database for commit-graph
error: Could not read df3c8a545e3e0f74bc33f945bbf7072fcdbffdfb
failed to parse commit df3c8a545e3e0f74bc33f945bbf7072fcdbffdfb from object database for commit-graph
error: Could not read e0892cefdaf4ffe7345a322de4f964514765c109
failed to parse commit e0892cefdaf4ffe7345a322de4f964514765c109 from object database for commit-graph
error: Could not read e095e2af3439642219617992adb25a5eddb53ef2
failed to parse commit e095e2af3439642219617992adb25a5eddb53ef2 from object database for commit-graph
error: Could not read e14e7fd66205e7cbe1de46188064a93e98bb019c
failed to parse commit e14e7fd66205e7cbe1de46188064a93e98bb019c from object database for commit-graph
error: Could not read e349f3f8e5bfab96b7dd64a64e5cad15b67d6c45
failed to parse commit e349f3f8e5bfab96b7dd64a64e5cad15b67d6c45 from object database for commit-graph
error: Could not read e5af83e63379133100422f94dbab377d8a110aec
failed to parse commit e5af83e63379133100422f94dbab377d8a110aec from object database for commit-graph
error: Could not read e5cba367a9e95b3b9e76112d5481d418809e8ea6
failed to parse commit e5cba367a9e95b3b9e76112d5481d418809e8ea6 from object database for commit-graph
error: Could not read e6ce7b383bfcb6a0ac0e5f05127c482dccbf112b
failed to parse commit e6ce7b383bfcb6a0ac0e5f05127c482dccbf112b from object database for commit-graph
error: Could not read e95b8b7c48b647348d35776a72189388b7b6a16e
failed to parse commit e95b8b7c48b647348d35776a72189388b7b6a16e from object database for commit-graph
error: Could not read ed93ed00e0e670b76687648b190ab4897f80681b
failed to parse commit ed93ed00e0e670b76687648b190ab4897f80681b from object database for commit-graph
error: Could not read ee20a8e7c4d921ae083e522604768fe9ee92ca10
failed to parse commit ee20a8e7c4d921ae083e522604768fe9ee92ca10 from object database for commit-graph
error: Could not read ee738cbee6d6ec001006bf0c04ab8a76c54d5730
failed to parse commit ee738cbee6d6ec001006bf0c04ab8a76c54d5730 from object database for commit-graph
error: Could not read eeb3157761a3c8e24061f048e4aab4c0c92ccc29
failed to parse commit eeb3157761a3c8e24061f048e4aab4c0c92ccc29 from object database for commit-graph
error: Could not read f45bde5fecb267d8e4ed844b52c5b98b87b5e47b
failed to parse commit f45bde5fecb267d8e4ed844b52c5b98b87b5e47b from object database for commit-graph
error: Could not read f57f9818862753ff8c2edb89b729f1e53158dc45
failed to parse commit f57f9818862753ff8c2edb89b729f1e53158dc45 from object database for commit-graph
error: Could not read f7789f55277e421174849a82503ead84bfa7a539
failed to parse commit f7789f55277e421174849a82503ead84bfa7a539 from object database for commit-graph
error: Could not read fa7c21784d8f4342afdb31b80342c3aecedc64e5
failed to parse commit fa7c21784d8f4342afdb31b80342c3aecedc64e5 from object database for commit-graph
error: Could not read fac60d3d66b579a851eb10ba93bb756a4499f5c1
failed to parse commit fac60d3d66b579a851eb10ba93bb756a4499f5c1 from object database for commit-graph
error: Could not read fe3852c45c192d4b5d59ba11a3ff5fea88fa7972
failed to parse commit fe3852c45c192d4b5d59ba11a3ff5fea88fa7972 from object database for commit-graph
error: Could not read fe5c1cad9ddbeeddb036c785332d4712954eb60f
failed to parse commit fe5c1cad9ddbeeddb036c785332d4712954eb60f from object database for commit-graph
error: Could not read feb797ae2d744dc9f669e12cf2d21fcf0f9f9f02
failed to parse commit feb797ae2d744dc9f669e12cf2d21fcf0f9f9f02 from object database for commit-graph
error: Could not read ffa68f60fc775b714061ce8e73959c603f9a4b84
failed to parse commit ffa68f60fc775b714061ce8e73959c603f9a4b84 from object database for commit-graph
Verifying commits in commit graph: 100% (2134/2134), done.
$ sudo /opt/gitlab/embedded/bin/git -C /app/gitlab/data/git-data/repositories/@hashed/0b/3f/0b3fe555ae8bd943feae4fb5e9ee5bebc608cafec26b75fe281b245ba635edc8.git count-objects -vH
count: 5
size: 20.00 KiB
in-pack: 26187
packs: 3
size-pack: 2.37 MiB
prune-packable: 0
garbage: 0
size-garbage: 0 bytes

I tried to run the Housekeeping via the GUI and the git gc and git repack command seem to have cleaned up a bit. The repository size changed and a few dangling objects were removed but the check still fails. So I tried to clone the repository myself and try to fix it. But to my surprise there were no issues anymore:

$ git clone --mirror https://git.unix.lan/tlb/project-tlb.git
Cloning into bare repository 'project-tlb.git'...
remote: Enumerating objects: 25343, done.
remote: Counting objects: 100% (235/235), done.
remote: Compressing objects: 100% (42/42), done.
remote: Total 25343 (delta 103), reused 228 (delta 96), pack-reused 25108
Receiving objects: 100% (25343/25343), 1.61 MiB | 4.56 MiB/s, done.
Resolving deltas: 100% (10766/10766), done.
$ cd project-tlb.git/
$ git fsck
Checking object directories: 100% (256/256), done.
Checking objects: 100% (25343/25343), done.
$ git  count-objects -vH
count: 0
size: 0 bytes
in-pack: 25343
packs: 1
size-pack: 2.29 MiB
prune-packable: 0
garbage: 0
size-garbage: 0 bytes

Is Gitlab doing some additional Housekeeping during cloning? Something seems to change. The git repository on the filesystem of the Gitlab server differs from the repository I’ve cloned even if I use the –mirror switch.

Is there any other way of handling this issues instead of running git gc and git repack command manually on the Gitlab server? How do I investigate this issue the best way? I still have no explanation why this happens now and why it is affecting more and more repositories.