Why follow people who use Twiter as IM anyway? One of the great things about Twitter is that people don't get too offended when you unfollow.
I think people will adapt to this however, though there may be a different style of replying to people to get around the changes (e.g. "To @jack: Are you ready")