I've been consulting over a year (US-based, near NYC) and I've found plenty of very good clients (small and large) through freelancing websites.
Few loose guidelines I've used to help me with applying to gigs:
1) Evaluate if you think the person understands the value of the work, and only reply if you can somewhat-confidently answer "yes."
2) Reply to gigs that say "$5" or some other crazy low number, as long as they seem competent at explaining their project.
3) ALWAYS follow up with your past clients! Ask them for new work regularly.