We just need to methodically sample the under sampled portions of the source distribution. Not more data, better data.
We just need to methodically sample the under sampled portions of the source distribution. Not more data, better data.
Could you elaborate on this?
The problem is that they don't exist in discrete missed data sets they only exist in larger data sets that also contain large amounts of well sampled data.
If you could separate out the existing data you could cherry-pick the under sampled data, but do that requires the very classifier you're trying to build in the first place.
This reaction is like saying "if we knew everything we'd be able to answer every question"
You don’t need a fancy model trained on all languages to tell you its training set underrepresented Finnish. You just need the training set curators to say “hey there’s no Finnish in the inputs”.
If the goal is high quality models, why be a purist about only using the resulting model to measure deficiencies in the training set?