This. Wholly agree. Currently running a large labelling task with 12 labelers.
Using Amazon ground truth which works fine (although seems quite MVP outside the core functionality e.g wrt reporting or user creation).
What tool have you had success with?