As you sort by first field anyway, could you please try out omitting field split (-t, -k1)? For me it gives a noticeable improvement:
$ stat --printf="%s\n" p.csv
1258291200
$ time sort -t, -k1 -S100% -o sorted.csv p.csv
real 0m50,186s user 4m6,962s sys 0m4,562s
$ time sort -o sorted.csv p.csv
real 0m43,483s user 3m36,473s sys 0m4,282s