Have you tried right clicking the whitespace? or are you talking about the charms bar, which does indeed take too long to come up?