After a bit of searching around I verified that there had been no activity in my GMail account since I left on Friday, so they couldn't have accessed the confirmation email to verify the Twitter account
Be sure to check your filters as a common attack is simply copying all mail to another account.