If you can move your VPS over to Amazon, EBS (Elastic Block Store) is what you are looking for, but it's likely not much cheaper than you're currently paying (EBS is priced at $0.10/month per gb, so $4/mo for 40gb of general purpose).
You can mount S3 buckets as a hard disk on a VPS, but that isn't the main use case for S3.