I've never heard anyone even suggest they were the cheapest. I've heard of a lot other adjectives, though.
Amazom is fairly cheap and is popular so you have lots of support dev-wise from communities.
What about features? Do other providers support something like AMIs, etc?