python harness.py [SHELL_NAME]
and it runs all the benchmarks in that directory using that shell.
Regarding building, I've tried to build all of the Qt port on Linux (what the online guides mention), but always fail in the dependencies. Perhaps I'll try the gtk port.