When you're looking for a designer, the rule is you try to find somebody who makes things you like looking at first. That's the most important part. Looking through their portfolio, then, you're trying to see the extent of their prowess. Do they rely on the same design tricks with every single layout they make (gradients, pretty buttons, slidy things), or are they making sure each web site does what it's supposed to do? Have they got any subtlety of understanding what a web site's needs are, or are they designing a bunch of things that look the same no matter what they're meant to be?
Then you talk to them. See if they "get" what you're talking about. Don't plan your questions in advance — conversations work better than interviews. Do they intuit your needs? If you have to clarify something that at first isn't clear, do they catch on to where you're going? You want somebody who's going to make the web site you want to make.
As for price: Offer what you can afford, and see if they'll take it. With designers, you never know. My team has taken $200 contracts because the work was simple enough and we liked the team offering. We've done freelance work because we liked the cause or liked the challenge and had an opening in our schedule.
The best way to find designers is to stick to people who've made work you like, or people you know, or people who've said interesting things, and contact them directly. Sort of like how directors stick to their favorite actors and cinematographers or, if they don't have any, they ask their friends to help out. Keep it personal. Personal does better work for you.
(If you're not speaking hypothetically, by the way, feel free to write me — we're open again for business starting Thursday. [/selfpromotion])