Someone had the issue on Debian, and they resolved it using my solution: Gitlab-ce Update Failing on bullseye - #2 by iwalker
Since Ubuntu is pretty much the same as Debian it should work for you as well.
Someone had the issue on Debian, and they resolved it using my solution: Gitlab-ce Update Failing on bullseye - #2 by iwalker
Since Ubuntu is pretty much the same as Debian it should work for you as well.