However the thing is about labels being noisy and using multiple labeling strategies to help train a higher fidelity model - https://www.snorkel.org/
However the thing is about labels being noisy and using multiple labeling strategies to help train a higher fidelity model - https://www.snorkel.org/
You are right there are a bunch of difficult problems this technique isn't perfect for, but it actually can still help improve the efficiency of labelling a lot and when I do it I get the added bonus of understanding the dataset a lot better.
Otherwise I overall agree with you that we should consider this where we can .. as evidenced by my snorkel link.
I think we are lazily giving up our intellectual power to models hoping that they will just discover patterns by magic, where it is actually very worth to go through the data science process starting with labelling because we actually learn as humans. The thesis is that this will also make our DL models better in the long run. We would never have come up with cool algorithms if we just always outsourced this work to models.