An error occurred while fetching the job log

I’m having trouble loading job logs for finished jobs. When navigating to a finished job (https://gitlab-instance/group/project/-/jobs/number), we see a loading animation which eventually times out, and a banner appears with the message in the title.

If i navigate to the job while it is running, the output is continously shown as expected. But just as the job finishes, the loading animation comes up again, and the banner eventually appears.

Viewing the raw log by pressing the “Show complete raw” redirects me to the s3-compatible store, and shows me the correct log.

Our setup:

  • Gitlab 12.5.4-ee (2a57951c0ee) installed on our on-prem Kubernetes cluster using helm chart version 2.5.5.
  • s3-compatible storage setup for all external storage (artifacts, lfs, registry, uploads, packages, externalDiffs, pseudonymizer).
  • ci_enabled_live_trace is enabled

Any tips on how to debug this further?

We’ve got the exact same issue. Did you manage to solve this?

No. I suspect it has something to do with the incremental logging architecture (https://docs.gitlab.com/ee/administration/job_logs.html#new-incremental-logging-architecture). But I’m not familiar enough with Gitlab or ruby to know where and what to look for.