Export failed

Hi All,

Have faced a different issue during the export of huge project in Gitlab version 10.6.4, The steps followed as below,

Project details 
- 4.7GB repo 
- 10K merge request with open merge request 100+ 
- Total of 3k+ issues. 

Method export 
- Entered to rails 
- Started the export for one project 
- No error captured 
- Export ran around 20 hours and there is no error 
- output file is is only 306kb

The only one output created under export path is VERSION file and no errors.

Please help me to find some methods to bypass this either only export the merge request and issues or to bypass this issue to export the entire project.

Hi All,

Fetched the failure of log as below, Please let me know if we can increase the timeout value

Import/Export error raised on /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/import_export/project_tree_saver.rb:21:in rescue in save': Connection timed out Import/Export backtrace: /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-3.3.5/lib/redis/connection/ruby.rb:90:in rescue in _read_from_socket’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-3.3.5/lib/redis/connection/ruby.rb:83:in _read_from_socket' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-3.3.5/lib/redis/connection/ruby.rb:75:in gets’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-3.3.5/lib/redis/connection/ruby.rb:380:in read' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-3.3.5/lib/redis/client.rb:262:in block in read’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-3.3.5/lib/redis/client.rb:250:in io' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-3.3.5/lib/redis/client.rb:261:in read’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-3.3.5/lib/redis/client.rb:120:in block in call' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-3.3.5/lib/redis/client.rb:231:in block (2 levels) in process’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-3.3.5/lib/redis/client.rb:367:in ensure_connected' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-3.3.5/lib/redis/client.rb:221:in block in process’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-3.3.5/lib/redis/client.rb:306:in logging' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-3.3.5/lib/redis/client.rb:220:in process’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-3.3.5/lib/redis/client.rb:120:in call' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/peek-redis-1.2.0/lib/peek/views/redis.rb:9:in call’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-3.3.5/lib/redis.rb:862:in block in get' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-3.3.5/lib/redis.rb:58:in block in synchronize’
/opt/gitlab/embedded/lib/ruby/2.3.0/monitor.rb:214:in mon_synchronize' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-3.3.5/lib/redis.rb:58:in synchronize’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-3.3.5/lib/redis.rb:861:in get' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-store-1.4.1/lib/redis/store/interface.rb:5:in get’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-store-1.4.1/lib/redis/store/serialization.rb:17:in get' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-store-1.4.1/lib/redis/store/namespace.rb:23:in block in get’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-store-1.4.1/lib/redis/store/namespace.rb:88:in namespace' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-store-1.4.1/lib/redis/store/namespace.rb:23:in get’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-activesupport-5.0.4/lib/active_support/cache/redis_store.rb:260:in block in read_entry' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-activesupport-5.0.4/lib/active_support/cache/redis_store.rb:242:in with’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/redis-activesupport-5.0.4/lib/active_support/cache/redis_store.rb:260:in read_entry' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.10/lib/active_support/cache.rb:558:in block in find_cached_entry’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.10/lib/active_support/cache.rb:547:in block in instrument' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.10/lib/active_support/notifications.rb:164:in block in instrument’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.10/lib/active_support/notifications/instrumenter.rb:20:in instrument' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.10/lib/active_support/notifications.rb:164:in instrument’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.10/lib/active_support/cache.rb:547:in instrument' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.10/lib/active_support/cache.rb:556:in find_cached_entry’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activesupport-4.2.10/lib/active_support/cache.rb:293:in fetch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/repository_cache.rb:22:in fetch’
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/repository_cache_adapter.rb:54:in cache_method_output' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/repository_cache_adapter.rb:16:in block in cache_method’
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/instrumentation.rb:161:in exists?' /opt/gitlab/embedded/service/gitlab-rails/app/models/repository.rb:101:in commit’
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/metrics/instrumentation.rb:161:in commit' /opt/gitlab/embedded/service/gitlab-rails/app/models/merge_request.rb:424:in block in source_branch_head’
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/utils/strong_memoize.rb:26:in strong_memoize' /opt/gitlab/embedded/service/gitlab-rails/app/models/merge_request.rb:422:in source_branch_head’
/opt/gitlab/embedded/service/gitlab-rails/app/models/merge_request.rb:449:in source_branch_sha' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activemodel-4.2.10/lib/active_model/serialization.rb:110:in block in serializable_hash’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activemodel-4.2.10/lib/active_model/serialization.rb:110:in each' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activemodel-4.2.10/lib/active_model/serialization.rb:110:in serializable_hash’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activerecord-4.2.10/lib/active_record/serialization.rb:17:in serializable_hash' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activemodel-4.2.10/lib/active_model/serialization.rb:114:in block (2 levels) in serializable_hash’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activemodel-4.2.10/lib/active_model/serialization.rb:114:in map' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activemodel-4.2.10/lib/active_model/serialization.rb:114:in block in serializable_hash’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activemodel-4.2.10/lib/active_model/serialization.rb:158:in block in serializable_add_includes' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activemodel-4.2.10/lib/active_model/serialization.rb:156:in each’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activemodel-4.2.10/lib/active_model/serialization.rb:156:in serializable_add_includes' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activemodel-4.2.10/lib/active_model/serialization.rb:112:in serializable_hash’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activerecord-4.2.10/lib/active_record/serialization.rb:17:in serializable_hash' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/activemodel-4.2.10/lib/active_model/serializers/json.rb:99:in as_json’
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/import_export/project_tree_saver.rb:34:in project_json' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/import_export/project_tree_saver.rb:28:in project_json_tree’
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/import_export/project_tree_saver.rb:18:in save' /opt/gitlab/embedded/service/gitlab-rails/app/services/projects/import_export/export_service.rb:12:in each’
/opt/gitlab/embedded/service/gitlab-rails/app/services/projects/import_export/export_service.rb:12:in all?' /opt/gitlab/embedded/service/gitlab-rails/app/services/projects/import_export/export_service.rb:12:in save_all’
/opt/gitlab/embedded/service/gitlab-rails/app/services/projects/import_export/export_service.rb:6:in execute' (irb):5:in irb_binding’
/opt/gitlab/embedded/lib/ruby/2.3.0/irb/workspace.rb:87:in eval' /opt/gitlab/embedded/lib/ruby/2.3.0/irb/workspace.rb:87:in evaluate’
/opt/gitlab/embedded/lib/ruby/2.3.0/irb/context.rb:380:in evaluate' /opt/gitlab/embedded/lib/ruby/2.3.0/irb.rb:489:in block (2 levels) in eval_input’
/opt/gitlab/embedded/lib/ruby/2.3.0/irb.rb:623:in signal_status' /opt/gitlab/embedded/lib/ruby/2.3.0/irb.rb:486:in block in eval_input’
/opt/gitlab/embedded/lib/ruby/2.3.0/irb/ruby-lex.rb:246:in block (2 levels) in each_top_level_statement' /opt/gitlab/embedded/lib/ruby/2.3.0/irb/ruby-lex.rb:232:in loop’
/opt/gitlab/embedded/lib/ruby/2.3.0/irb/ruby-lex.rb:232:in block in each_top_level_statement' /opt/gitlab/embedded/lib/ruby/2.3.0/irb/ruby-lex.rb:231:in catch’
/opt/gitlab/embedded/lib/ruby/2.3.0/irb/ruby-lex.rb:231:in each_top_level_statement' /opt/gitlab/embedded/lib/ruby/2.3.0/irb.rb:485:in eval_input’
/opt/gitlab/embedded/lib/ruby/2.3.0/irb.rb:395:in block in start' /opt/gitlab/embedded/lib/ruby/2.3.0/irb.rb:394:in catch’
/opt/gitlab/embedded/lib/ruby/2.3.0/irb.rb:394:in start' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/railties-4.2.10/lib/rails/commands/console.rb:110:in start’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/railties-4.2.10/lib/rails/commands/console.rb:9:in start' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/railties-4.2.10/lib/rails/commands/commands_tasks.rb:68:in console’
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/railties-4.2.10/lib/rails/commands/commands_tasks.rb:39:in run_command!' /opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/railties-4.2.10/lib/rails/commands.rb:17:in <top (required)>’
bin/rails:9:in require' bin/rails:9:in ’

1 Like