I used to get teased for this constantly as a teenager. Every time the weather was nice, and especially if I was returning home from a holiday in a sunny destination, I knew I'd get the same idiotic comments about my failure to get a tan. I hated it, and I resented people who said this to me. Not because I'm insecure about the colour of my skin (really, I don't give a fuck about tanning) - just that it was so boring. The same stupid, boring, tedious jokes again and again and again and again and again and again and again. Give me a break.
This doesn't make me a victim of racism, and I can't think of any other disadvantages to my skin colour except perhaps an increased suncream budget. But I do find it offensive. You're not funny, and I've heard it a million times before.
Rant over.
(Edit: to be clear, I don't find it offensive if someone simply described me as "white" or "pale" - only when they make unoriginal jokes about it.)