607 karma · joined November 18, 2007
It would be nice if this got updated for Additional Checksums.
Correction: and also part quantity (parsed from etag) for comparison
CopyObject writes a single part object and can read from a multipart object, as long as the parts total less than the 5 gibibyte limit for a single part.
For future writes, s3:ObjectCreated:CompleteMultipartUpload event can trigger CopyObject, else defrag to policy size parts. Boto copy() with multipart_chunksize configured is the most convenient implementation, other SDKs lack an equivalent.
For past writes, existing multipart objects can be selected from inventory filtering ETag column length greater than 32 characters. Dividing object size by part size might hint if part size is policy.
> To create a trailing checksum when using an AWS SDK, populate the ChecksumAlgorithm parameter with your preferred algorithm. The SDK uses that algorithm to calculate the checksum for your object (or object parts) and automatically appends it to the end of your upload request. This behavior saves you time because Amazon S3 performs both the verification and upload of your data in a single pass. https://docs.aws.amazon.com/AmazonS3/latest/userguide/checki...
shopt -s globstar
tail -n+1 **/*.py | pbcopy $ ls
$ cat >a.c <<EOF
int main(){return 42;}
EOF
$ make a
cc a.c -o a
$ ./a; echo $?
42
$You might like one of these:
auto_resume=
auto_resume=substring $ nc -vzw1 host port