Heroku has open-sourced the product they use to upload WAL files to S3. Can confirm (not with S3, but with Swift) that it works fantastically:

https://github.com/wal-e/wal-e