Held on to my last SE until the cracks were too many and I had to put pressure on the cable to get it charging...
Did you try using a safety pin to remove dust from the USB port? Works everytime with a bunch of friends who had an SE but could not charge it properly.
Wha! I'll try this in the morning, I've been still using it on the side.