Definitely. I did a lot of applying and interviewing when I was first looking for a job out of school, and it's amazing how disorganized some companies are. I will always specifically remember the companies that may have said "no" but were timely and polite, and I'd recommend them to my colleagues. On the other hand I also remember the companies that were rude or disorganized and recommend against them when asked.

Bottom line: Candidates should always like you even if you don't like or need them, especially since you'll likely reject far more people than you hire.