My name is Charles. I moved to the USA and everyone tries to call me "Chuck", which to my British psyche is horrible for the same linguistic reason.
https://en.wiktionary.org/wiki/dicker
It's certainly not polite but people claiming it's lewd have about as much ground to stand on as they do with the word "pussycat"