Sounds like something to use Kinesis[1] for. Read the kinesis stream, process the updates and write/rewrite the S3 file.
Something like that might work if you only periodically rewrote the S3 file (e.g. once an hour). But it's still much less efficient than just allowing delta updates.