Hmm, this got me interested. Found a tool which I can use to test myself what kind of difference do I hear: https://www.audiocheck.net/blindtests_timing_2w.php?time=5
With some training I could achieve >95% confidence in discernig 5ms with my headphones.