I've been tempted to do just that: Convert all my Amazon kindle books into MOBI and get out of the "walled garden" as you put it. There was one thing stopping me though. I have an inherent need to support authors as much as I can since I not only wanted to be a writer when I was a kid, but I actually ended up writing a few short stories and a couple of novels. All unpublished off course since they where not mature (as in experience and style) enough. I fear that if I get out of the walled garden I'll end up buying a lot less books (and supporting authors less and less) because of how easy it is to get books online, and I don't necessarily mean pirating FYI.
So yeah, I installed Calibre and was amazed by the flexibility it gave me... and I uninstalled it an hour later because I realized that I couldn't support authors if it was that easy not to do so.
In any case this is great information, thanks for the walkthrough. maybe one day I'll go ahead with it and get out of Amazons lawn (get it get it? garden && lawn?)