This exact same phenomenon bit me at a previous job. We hired a couple of really smooth-talking grifters, and it took a tremendous amount of time to get rid of them. Vibes matter.
If you go with vibes too much you only ever accumulate data saying that vibes matter.