Problem to solve
We currently run several jobs in parallel, all of them are using same shared cache. The problem is - it seems that not all cache has being uploaded to the shared S3 server, although the report says it is. In other words some files being generated in cache folder during run will not appear in remote cache during manual inspection.
I suppose that happens due to parallel execution of jobs. Can someone give an advise how properly manage this situation?
Steps to reproduce
- Run several jobs in parallel, each generating its own artifacts to the cache folder
- Inspect resulting cache
Versions
We are using self-managed GitLab Community Edition v16.11.10 and minio RELEASE.2025-04-22T22-12-26Z as S3 server