Can't access gitlab CE anymore

I’m running 9.5.4 CE Omnibus edition on Debian 8.9 (Jessie). I am having issues accessing the gitlab login page. If I try to access it from any machine on my network, I get the following:

image

If I try to access it from gitlab machine directly via curl http://127.0.0.1/users/sign_in (or the boxes IP) I can see the html for the signin page. Nothing’s changed in my gitlab.rb config file

## THIS CONFIGURATION IS MANAGED BY PUPPET
# for all possible paramters, see:
# https://gitlab.com/gitlab-org/omnibus-gitlab/blob/master/files/gitlab-config-template/gitlab.rb.template

## Url on which GitLab will be reachable.
## For more details on configuring external_url see:
## https://gitlab.com/gitlab-org/omnibus-gitlab/blob/629def0a7a26e7c2326566f0758d4a27857b52a3/README.md#configuring-the-external-url-for-gitlab
external_url 'https://gitlab.<site>.com'

############################
# gitlab.yml configuration #
############################

gitlab_rails['backup_keep_time'] = '604800'
gitlab_rails['backup_path'] = '/var/gitlab_backups'
gitlab_rails['backup_upload_connection'] = {"local_root"=>"/mnt/backups", "provider"=>"Local"}
gitlab_rails['backup_upload_remote_directory'] = 'gitlab_backups'
gitlab_rails['extra_google_analytics_id'] = <GA id>'
gitlab_rails['git_timeout'] = '300'
gitlab_rails['gitlab_default_theme'] = '2'
gitlab_rails['gitlab_email_from'] = '<email>'
gitlab_rails['omniauth_allow_single_sign_on'] = true
gitlab_rails['omniauth_block_auto_created_users'] = true
gitlab_rails['omniauth_enabled'] = true
gitlab_rails['smtp_address'] = 'smtp.gmail.com'
gitlab_rails['smtp_domain'] = 'gmail.com'
gitlab_rails['smtp_enable'] = true
gitlab_rails['smtp_enable_starttls_auto'] = true
gitlab_rails['smtp_password'] = '<password>'
gitlab_rails['smtp_port'] = '587'
gitlab_rails['smtp_tls'] = false
gitlab_rails['smtp_user_name'] = '<email>'
gitlab_rails['time_zone'] = 'America/Los_Angeles'
gitlab_rails['webhook_timeout'] = '10'

##################
# GitLab Unicorn #
##################
## Tweak unicorn settings.

unicorn['worker_processes'] = '5'
unicorn['worker_timeout'] = '60'

################
# GitLab Nginx #
################
## see: https://gitlab.com/gitlab-org/omnibus-gitlab/tree/629def0a7a26e7c2326566f0758d4a27857b52a3/doc/settings/nginx.md

nginx['custom_gitlab_server_config'] = 'location /nginx_status { stub_status on; access_log off; allow 192.168.0.0/16; allow ::1; deny all; }'
nginx['keepalive_timeout'] = '600'
nginx['listen_https'] = false
nginx['listen_port'] = '80'
nginx['redirect_http_to_https'] = false

##################
# GitLab Logging #
##################
## see: https://gitlab.com/gitlab-org/omnibus-gitlab/tree/629def0a7a26e7c2326566f0758d4a27857b52a3/README.md#logs

logging['svlogd_size'] = '200 * 1024 * 1024'

I’ve tried gitlab-ctl tail, but I don’t see anything outstanding as an issue in the logs. I’m not sure where to start trying to troubleshoot this, I’ve checked that 80 is open from outside the box:

If there are any logs i can post that will help, I’ll be more than glad to (it’s a personal instance, so nothing that’s company sensitive.

hmm. so restarting nginx twice seems to make the login page show, but now i get a

==> /var/log/gitlab/gitlab-rails/production.log <==
Can't verify CSRF token authenticity
Completed 422 Unprocessable Entity in 44ms (ActiveRecord: 8.1ms)

==> /var/log/gitlab/gitlab-rails/production_json.log <==
{"method":"POST","path":"/users/sign_in","format":"html","controller":"SessionsController","action":"create","status":422,"error":"ActionController::InvalidAuthenticityToken: ActionController::InvalidAuthenticityToken","duration":51.12,"view":0.0,"db":8.14,"time":"2017-09-10T01:15:42.306Z","params":{"utf8":"✓","authenticity_token":"[FILTERED]","user":{"login":"erichardson","password":"[FILTERED]","remember_me":"0"}},"remote_ip":"192.168.1.45","user_id":null,"username":null}

==> /var/log/gitlab/gitlab-rails/production.log <==

ActionController::InvalidAuthenticityToken (ActionController::InvalidAuthenticityToken):
  lib/gitlab/middleware/multipart.rb:93:in `call'
  lib/gitlab/request_profiler/middleware.rb:14:in `call'
  lib/gitlab/middleware/go.rb:17:in `call'
  lib/gitlab/etag_caching/middleware.rb:11:in `call'
  lib/gitlab/middleware/rails_queue_duration.rb:20:in `call'
  lib/gitlab/metrics/rack_middleware.rb:29:in `block in call'
  lib/gitlab/metrics/transaction.rb:49:in `run'
  lib/gitlab/metrics/rack_middleware.rb:29:in `call'
  lib/gitlab/request_context.rb:18:in `call'
  lib/gitlab/metrics/requests_rack_middleware.rb:27:in `call'

Not too sure about this but did you check versions of all required software? Gitlab requires at least ruby 2.3.

https://docs.gitlab.com/ce/install/requirements.html