Most bittorrent clients rank their peers by upload speed when they choose who to upload their pieces to. You could still download a file if you refused to upload (afaik seeds will upload to anyone), but you would probably experience a decrease in speed.