Are you using GitLab.com or hosting it yourself? We're working on improving GitLab.com, but self-hosting GitLab should be pretty fast in most circumstances.
As for the interface, we're working on improving the design of the product and have just hired a UX Researcher to help with that. Would be happy to hear any specifics you have to offer.