I cheated a little bit by creating an AI that allowed me to do it faster in a semi-automatic fashion. However, the first batch to train this "labeling"-network was generated manually, which took forever.
That semi-automatic AI seems like a useful product as well, for a different task