But the sea level is not rising any faster than it has since the Holocene was established.
Firstly, XKCD is a comic, and its wrong about the temperature timeline. They completely skip over the Younger Dryas, which is very well documented: https://en.wikipedia.org/wiki/Younger_Dryas#/media/File:Youn...
(also note from this data, that the earth was warmer in the first half of the Holocene, we have been trending lower despite the recent mild increases)
Secondly, no we do not have evidence that it's rising faster than any time in the past 20K years. The end of Younger Dryas was a 20C increase in less than a couple hundred centuries.
Take a look at the sea level proximal data for the Holocene: https://en.wikipedia.org/wiki/Early_Holocene_sea_level_rise#...
The modern sea level rise is barely visible on that chart.