You should pay to check whether the message is available because your requests cost Amazon money. That way, if you don't care to poll frequently, you won't be forced to pay some average price that's driven up by other users who do need to poll often. In fact, this is more fair.
Disclaimer: I used to work at AWS, though it was 2+ years ago and I didn't work on SQS.