I haven't spent much time in the world of JVM tuning, but if latency is your main concern the relatively new ZGC should be your jam: https://wiki.openjdk.java.net/display/zgc/Main
Also, what are the parameters for this assessment (cpu count, cpu frequency, memory frequency, heap size, object demography etc)?
https://wiki.openjdk.java.net/display/zgc/
I think the plan is to reach the 1ms worst-case goal in 15 or 16.
I might do some performance tests of my own soon.