Gitlab now has prepackaged downloads available for Ubuntu and CentOS[0]. I originally setup 2 Gitlab servers a long time ago, one I replaced with the new package version and the other I'm fixing to. It was tough to maintain and upgrade if it worked, but the package versions have been super simple.