No, you don't have to sweep, but you're allowed to. Playing without sweeping is throwing out half the game, and a big part of what makes it hard.