Michael Jordan's talk "Are You a Bayesian or a Frequentist?" is one of the better treatments of this topic IMO.
(talk): http://videolectures.net/mlss09uk_jordan_bfway/
(slides): http://mlg.eng.cam.ac.uk/mlss09/mlss_slides/Jordan_1.pdf
(talk): http://videolectures.net/mlss09uk_jordan_bfway/
(slides): http://mlg.eng.cam.ac.uk/mlss09/mlss_slides/Jordan_1.pdf
IMO he nails the key distinction here: "One definition says that a frequentist is a Bayesian trying to do well, or at least not too badly, against any possible prior distribution."
And there's some nice humor also: "The 250-year debate between Bayesians and frequentists is unusual among philosophical arguments in actually having important practical consequences."
[1]: http://statweb.stanford.edu/~ckirby/brad/papers/2005BayesFre...