13:update reference: running pre-receive hooks: GitLab: Internal API unreachable

How to Use GitLab Self-managed
1

:hugs: Please help fill in this template with all the details to help others help you more efficiently. Use formatting blocks for code, config, logs and ensure to remove sensitive data.

Problem to solve

13:update reference: running pre-receive hooks: GitLab: Internal API unreachable.
Describe your question in as much detail as possible:
not able to create new page in wiki

  • What are you seeing, and how does that differ from what you expect to see?
    13:update reference: running pre-receive hooks: GitLab: Internal API unreachable.

  • Consider including screenshots, error messages, and/or other helpful visuals
    image

Steps to reproduce

1 - go to projects
2 - select project
3 - select project plan
4 - select wiki
5 - create new page

then i am seeing this error
Which troubleshooting steps have you already taken? Can you link to any docs or other resources so we know where you have been?
1 - Upgrade all gitlab environment
2 - renew certificates
3 - already check updated ched version

Configuration

Provide screenshots from the GitLab UI showing relevant configuration, if applicable.

On self-managed instances, add the relevant configuration settings or changes.

Versions

Please select whether options apply, and add the version information.

Versions

Helpful resources

  1. Before opening a new topic, make sure to search for keywords in the forum search
  2. Check the GitLab project for existing issues. If you encounter a bug, please create a bug report issue.
  3. Troubleshooting docs: Self-managed GitLab instances.

Thanks for taking the time to be thorough in your request, it really helps! :blush:

2

any updates

3

same problem here.

Git version: Docker ce 17.2.1
Error occurs when:

  • Create branch from web
  • MR from web
  • Push code from local

Error log:
/main/logs/gitlab-rails# tail -n 100 exceptions_json.log

{
   "severity":"ERROR",
   "time":"2024-08-16T03:39:11.313Z",
   "correlation_id":"01xxxxxxxxxxxxxxxxxxx",
   "meta.caller_id":"POST /api/:version/projects/:id/repository/commits",
   "meta.remote_ip":"11.22.33.44",
   "meta.feature_category":"source_code_management",
   "meta.user":"my.user",
   "meta.user_id":99,
   "meta.project":",my-namespace/my-project",
   "meta.root_namespace":"my-namespace",
   "meta.client_id":"user/99",
   "exception.class":"Gitlab::Git::CommandError",
   "exception.message":"13:update reference: running pre-receive hooks: GitLab: Internal API error (500).",
   "exception.backtrace":[
      "lib/gitlab/git/wraps_gitaly_errors.rb:24:in `rescue in wrapped_gitaly_errors'",
      "lib/gitlab/git/wraps_gitaly_errors.rb:6:in `wrapped_gitaly_errors'",
      "lib/gitlab/git/repository.rb:1017:in `commit_files'",
      "app/models/repository.rb:888:in `block in commit_files'",
      "app/models/repository.rb:871:in `with_cache_hooks'",
      "app/models/repository.rb:888:in `commit_files'",
      "app/services/files/multi_service.rb:41:in `commit_actions!'",
      "app/services/files/multi_service.rb:13:in `create_commit!'",
      "app/services/commits/create_service.rb:30:in `execute'",
      "lib/api/commits.rb:239:in `block (2 levels) in \u003cclass:Commits\u003e'",
      "grape (2.0.0) lib/grape/endpoint.rb:58:in `call'",
      "grape (2.0.0) lib/grape/endpoint.rb:58:in `block (2 levels) in generate_api_method'",
      "activesupport (7.0.8.4) lib/active_support/notifications.rb:208:in `instrument'",
      "grape (2.0.0) lib/grape/endpoint.rb:57:in `block in generate_api_method'",
      "grape (2.0.0) lib/grape/endpoint.rb:328:in `execute'",
      "grape (2.0.0) lib/grape/endpoint.rb:260:in `block in run'",
      "activesupport (7.0.8.4) lib/active_support/notifications.rb:208:in `instrument'",
      "grape (2.0.0) lib/grape/endpoint.rb:240:in `run'",
      "grape (2.0.0) lib/grape/endpoint.rb:316:in `block in build_stack'",
      "grape (2.0.0) lib/grape/middleware/base.rb:36:in `call!'",
      "grape (2.0.0) lib/grape/middleware/base.rb:29:in `call'",
      "grape (2.0.0) lib/grape/middleware/base.rb:36:in `call!'",
      "grape (2.0.0) lib/grape/middleware/base.rb:29:in `call'",
      "grape (2.0.0) lib/grape/middleware/base.rb:36:in `call!'",
      "grape (2.0.0) lib/grape/middleware/base.rb:29:in `call'",
      "lib/api/api_guard.rb:219:in `call'",
      "grape (2.0.0) lib/grape/middleware/base.rb:36:in `call!'",
      "grape (2.0.0) lib/grape/middleware/base.rb:29:in `call'",
      "rack-oauth2 (1.21.3) lib/rack/oauth2/server/resource.rb:20:in `_call'",
      "rack-oauth2 (1.21.3) lib/rack/oauth2/server/resource/bearer.rb:8:in `_call'",
      "rack-oauth2 (1.21.3) lib/rack/oauth2/server/abstract/handler.rb:17:in `call'",
      "grape (2.0.0) lib/grape/middleware/error.rb:39:in `block in call!'",
      "grape (2.0.0) lib/grape/middleware/error.rb:38:in `catch'",
      "grape (2.0.0) lib/grape/middleware/error.rb:38:in `call!'",
      "grape (2.0.0) lib/grape/middleware/base.rb:29:in `call'",
      "grape_logging (1.8.4) lib/grape_logging/middleware/request_logger.rb:60:in `block in call!'",
      "grape_logging (1.8.4) lib/grape_logging/middleware/request_logger.rb:58:in `catch'",
      "grape_logging (1.8.4) lib/grape_logging/middleware/request_logger.rb:58:in `call!'",
      "grape (2.0.0) lib/grape/middleware/base.rb:29:in `call'",
      "rack (2.2.9) lib/rack/head.rb:12:in `call'",
      "grape (2.0.0) lib/grape/endpoint.rb:224:in `call!'",
      "grape (2.0.0) lib/grape/endpoint.rb:218:in `call'",
      "grape (2.0.0) lib/grape/router/route.rb:58:in `exec'",
      "grape (2.0.0) lib/grape/router.rb:120:in `process_route'",
      "grape (2.0.0) lib/grape/router.rb:74:in `block in identity'",
      "grape (2.0.0) lib/grape/router.rb:94:in `transaction'",
      "grape (2.0.0) lib/grape/router.rb:72:in `identity'",
      "grape (2.0.0) lib/grape/router.rb:56:in `block in call'",
      "grape (2.0.0) lib/grape/router.rb:136:in `with_optimization'",
      "grape (2.0.0) lib/grape/router.rb:55:in `call'",
      "grape (2.0.0) lib/grape/api/instance.rb:165:in `call'",
      "grape (2.0.0) lib/grape/api/instance.rb:70:in `call!'",
      "grape (2.0.0) lib/grape/api/instance.rb:65:in `call'",
      "actionpack (7.0.8.4) lib/action_dispatch/routing/mapper.rb:19:in `block in \u003cclass:Constraints\u003e'",
      "actionpack (7.0.8.4) lib/action_dispatch/routing/mapper.rb:48:in `serve'",
      "actionpack (7.0.8.4) lib/action_dispatch/journey/router.rb:50:in `block in serve'",
      "actionpack (7.0.8.4) lib/action_dispatch/journey/router.rb:32:in `each'",
      "actionpack (7.0.8.4) lib/action_dispatch/journey/router.rb:32:in `serve'",
      "actionpack (7.0.8.4) lib/action_dispatch/routing/route_set.rb:852:in `call'",
      "gitlab-experiment (0.9.1) lib/gitlab/experiment/middleware.rb:19:in `call'",
      "flipper (0.26.2) lib/flipper/middleware/memoizer.rb:72:in `memoized_call'",
      "flipper (0.26.2) lib/flipper/middleware/memoizer.rb:37:in `call'",
      "lib/gitlab/metrics/elasticsearch_rack_middleware.rb:16:in `call'",
      "lib/gitlab/middleware/sidekiq_shard_awareness_validation.rb:20:in `block in call'",
      "lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'",
      "lib/gitlab/middleware/sidekiq_shard_awareness_validation.rb:20:in `call'",
      "lib/gitlab/middleware/memory_report.rb:13:in `call'",
      "lib/gitlab/middleware/speedscope.rb:13:in `call'",
      "lib/gitlab/database/load_balancing/rack_middleware.rb:23:in `call'",
      "lib/gitlab/middleware/rails_queue_duration.rb:33:in `call'",
      "lib/gitlab/etag_caching/middleware.rb:21:in `call'",
      "lib/gitlab/metrics/rack_middleware.rb:16:in `block in call'",
      "lib/gitlab/metrics/web_transaction.rb:46:in `run'",
      "lib/gitlab/metrics/rack_middleware.rb:16:in `call'",
      "lib/gitlab/middleware/go.rb:24:in `call'",
      "lib/gitlab/middleware/query_analyzer.rb:11:in `block in call'",
      "lib/gitlab/database/query_analyzer.rb:40:in `within'",
      "lib/gitlab/middleware/query_analyzer.rb:11:in `call'",
      "lib/gitlab/middleware/organizations/current.rb:20:in `call'",
      "batch-loader (2.0.5) lib/batch_loader/middleware.rb:11:in `call'",
      "rack-attack (6.7.0) lib/rack/attack.rb:103:in `call'",
      "apollo_upload_server (2.1.6) lib/apollo_upload_server/middleware.rb:19:in `call'",
      "lib/gitlab/middleware/multipart.rb:173:in `call'",
      "rack-attack (6.7.0) lib/rack/attack.rb:127:in `call'",
      "warden (1.2.9) lib/warden/manager.rb:36:in `block in call'",
      "warden (1.2.9) lib/warden/manager.rb:34:in `catch'",
      "warden (1.2.9) lib/warden/manager.rb:34:in `call'",
      "rack-cors (2.0.2) lib/rack/cors.rb:102:in `call'",
      "rack (2.2.9) lib/rack/tempfile_reaper.rb:15:in `call'",
      "rack (2.2.9) lib/rack/etag.rb:27:in `call'",
      "rack (2.2.9) lib/rack/conditional_get.rb:40:in `call'",
      "rack (2.2.9) lib/rack/head.rb:12:in `call'",
      "actionpack (7.0.8.4) lib/action_dispatch/http/permissions_policy.rb:38:in `call'",
      "actionpack (7.0.8.4) lib/action_dispatch/http/content_security_policy.rb:36:in `call'",
      "lib/gitlab/middleware/read_only/controller.rb:50:in `call'",
      "lib/gitlab/middleware/read_only.rb:18:in `call'",
      "lib/gitlab/middleware/unauthenticated_session_expiry.rb:18:in `call'",
      "rack (2.2.9) lib/rack/session/abstract/id.rb:266:in `context'",
      "rack (2.2.9) lib/rack/session/abstract/id.rb:260:in `call'",
      "actionpack (7.0.8.4) lib/action_dispatch/middleware/cookies.rb:704:in `call'",
      "lib/gitlab/middleware/same_site_cookies.rb:27:in `call'",
      "actionpack (7.0.8.4) lib/action_dispatch/middleware/callbacks.rb:27:in `block in call'",
      "activesupport (7.0.8.4) lib/active_support/callbacks.rb:99:in `run_callbacks'",
      "actionpack (7.0.8.4) lib/action_dispatch/middleware/callbacks.rb:26:in `call'",
      "sentry-rails (5.17.3) lib/sentry/rails/rescued_exception_interceptor.rb:12:in `call'",
      "actionpack (7.0.8.4) lib/action_dispatch/middleware/debug_exceptions.rb:28:in `call'",
      "lib/gitlab/middleware/path_traversal_check.rb:27:in `call'",
      "lib/gitlab/middleware/handle_malformed_strings.rb:21:in `call'",
      "sentry-ruby (5.17.3) lib/sentry/rack/capture_exceptions.rb:29:in `block (2 levels) in call'",
      "sentry-ruby (5.17.3) lib/sentry/hub.rb:251:in `with_session_tracking'",
      "sentry-ruby (5.17.3) lib/sentry-ruby.rb:403:in `with_session_tracking'",
      "sentry-ruby (5.17.3) lib/sentry/rack/capture_exceptions.rb:20:in `block in call'",
      "sentry-ruby (5.17.3) lib/sentry/hub.rb:59:in `with_scope'",
      "sentry-ruby (5.17.3) lib/sentry-ruby.rb:383:in `with_scope'",
      "sentry-ruby (5.17.3) lib/sentry/rack/capture_exceptions.rb:19:in `call'",
      "actionpack (7.0.8.4) lib/action_dispatch/middleware/show_exceptions.rb:29:in `call'",
      "lib/gitlab/middleware/basic_health_check.rb:25:in `call'",
      "lograge (0.11.2) lib/lograge/rails_ext/rack/logger.rb:15:in `call_app'",
      "railties (7.0.8.4) lib/rails/rack/logger.rb:25:in `block in call'",
      "activesupport (7.0.8.4) lib/active_support/tagged_logging.rb:99:in `block in tagged'",
      "activesupport (7.0.8.4) lib/active_support/tagged_logging.rb:37:in `tagged'",
      "activesupport (7.0.8.4) lib/active_support/tagged_logging.rb:99:in `tagged'",
      "railties (7.0.8.4) lib/rails/rack/logger.rb:25:in `call'",
      "actionpack (7.0.8.4) lib/action_dispatch/middleware/remote_ip.rb:93:in `call'",
      "lib/gitlab/middleware/handle_ip_spoof_attack_error.rb:25:in `call'",
      "lib/gitlab/middleware/request_context.rb:15:in `call'",
      "lib/gitlab/middleware/webhook_recursion_detection.rb:15:in `call'",
      "request_store (1.5.1) lib/request_store/middleware.rb:19:in `call'",
      "rack (2.2.9) lib/rack/method_override.rb:24:in `call'",
      "rack (2.2.9) lib/rack/runtime.rb:22:in `call'",
      "rack-timeout (0.7.0) lib/rack/timeout/core.rb:154:in `block in call'",
      "rack-timeout (0.7.0) lib/rack/timeout/support/timeout.rb:19:in `timeout'",
      "rack-timeout (0.7.0) lib/rack/timeout/core.rb:153:in `call'",
      "config/initializers/fix_local_cache_middleware.rb:11:in `call'",
      "lib/gitlab/middleware/compressed_json.rb:44:in `call'",
      "actionpack (7.0.8.4) lib/action_dispatch/middleware/executor.rb:14:in `call'",
      "lib/gitlab/middleware/rack_multipart_tempfile_factory.rb:19:in `call'",
      "rack (2.2.9) lib/rack/sendfile.rb:110:in `call'",
      "lib/gitlab/middleware/sidekiq_web_static.rb:20:in `call'",
      "lib/gitlab/metrics/requests_rack_middleware.rb:79:in `call'",
      "gitlab-labkit (0.36.1) lib/labkit/middleware/rack.rb:22:in `block in call'",
      "gitlab-labkit (0.36.1) lib/labkit/context.rb:35:in `with_context'",
      "gitlab-labkit (0.36.1) lib/labkit/middleware/rack.rb:21:in `call'",
      "actionpack (7.0.8.4) lib/action_dispatch/middleware/request_id.rb:26:in `call'",
      "actionpack (7.0.8.4) lib/action_dispatch/middleware/host_authorization.rb:131:in `call'",
      "railties (7.0.8.4) lib/rails/engine.rb:530:in `call'",
      "railties (7.0.8.4) lib/rails/railtie.rb:226:in `public_send'",
      "railties (7.0.8.4) lib/rails/railtie.rb:226:in `method_missing'",
      "lib/gitlab/middleware/release_env.rb:13:in `call'",
      "rack (2.2.9) lib/rack/urlmap.rb:74:in `block in call'",
      "rack (2.2.9) lib/rack/urlmap.rb:58:in `each'",
      "rack (2.2.9) lib/rack/urlmap.rb:58:in `call'",
      "puma (6.4.0) lib/puma/configuration.rb:272:in `call'",
      "puma (6.4.0) lib/puma/request.rb:100:in `block in handle_request'",
      "puma (6.4.0) lib/puma/thread_pool.rb:378:in `with_force_shutdown'",
      "puma (6.4.0) lib/puma/request.rb:99:in `handle_request'",
      "puma (6.4.0) lib/puma/server.rb:443:in `process_client'",
      "puma (6.4.0) lib/puma/server.rb:241:in `block in run'",
      "puma (6.4.0) lib/puma/thread_pool.rb:155:in `block in spawn_thread'"
   ],
   "exception.cause_class":"GRPC::Internal",
   "exception.gitaly":"{:storage=\u003e\"default\", :address=\u003e\"unix:/var/opt/gitlab/gitaly/gitaly.socket\", :service=\u003e:operation_service, :rpc=\u003e:user_commit_files}",
   "user.username":"my.user",
   "tags.program":"myprogram",
   "tags.locale":"en",
   "tags.feature_category":"source_code_management",
   "tags.correlation_id":"01xxxxxxxxx"