If you're on a mac I have a good blog post which shows how to setup aquamacs for clojure.
http://jaydonnell.com/blog/2011/10/07/setting-up-aquamacs-fo...
The steps are pretty much the same for regular emacs, you just need to put things in ~/.emacs.d/ instead of ~/Library/Preferences/Aquamacs\ Emacs/