Locked out of gitlab.com after fiddling with SAML and AWS SSO

We are trialing GitLab.com and while fiddling with the SSO settings, we managed to lock ourselves out of Gitlab. We have SAML marked as required and our SAML SSO settings are broken. The local GitLab (non SAML) admin user we have, tries to get SAML authentication.
Any ideas on how to let ourselves back into our group?