Couldn't agree more. Gitolite is enough for most use cases, and for technical users which often use other tools there's no need for a web interface (or anything beyond gitweb anyway).

We use it in combination with BugsEverywhere for issue tracking, with the added advantage that bugs are tracked per-branch. You can work offline without issues.

The major complaint with this system is the disconnect for users to report issues. BE includes a web frontend, but it's not great.

We use mantis as a general tracker, but still keep detailed bug tracking in the VCS with BE.