Sorry I meant to tune sort
LC_ALL=C sort --parallel=16 -t, -k1 -S100% -f -s --batch-size=1024 -T/home /tmp/test LC_ALL=C sort --parallel=16 -t, -k1 -S100% -f -s --batch-size=1024 -T/home /tmp/test real 30m54.557s
user 82m9.055s
sys 3m1.723s
no improvement over sort without the batch-size...