To add to the different choices, use octopress [1] with github pages [2]. I was evaluating various choices when I decided to create my own blog, and I found it was the only solution that:
1. Does not cost me anything
2. Lets me use my custom domain name
3. Gives me control over the generated HTML, but also gives me a starting point in the form of some decent looking themes [3].
4. Actually works (I'm looking at you, bitbucket).
5. Gives me control over my content. Github decides to close its service? No problem, I got all my content and its history in my local git repo, so I can migrate it to anything I think is better.
If there is another option that fulfills these criteria I would like to know.
[1]: http://octopress.org [2]: http://pages.github.com [3]: http://octopressthemes.com