In my case, my new number (for my android phone) is associated with someone else's iPhone. I could not de-authorize that person's iMessage token. I handpicked that number but had to give it up thanks to iMessage's implementation.