What could be said is that it is a non-partisan measurement error both sides can abuse equally.
The number of people needing jobs, regardless of searching might have gone down similarly to the reported number, or it might have stayed exactly the same overall. Without the information, we don't know. I certainly know a few people who need jobs and can't get them, and some of them aren't being counted. Maybe it would be good to find out.
The folks you seem to be saying are part of discourage and marginally attached workers, and are counted as part of the U5 and U6 measurement. When we talk about the large big pot of unemployed and want to work or don’t have enough work, U6 is the measure usually referred to.
We are improving on that measure as well. http://www.bls.gov/news.release/empsit.t15.htm