Certainly some people care a lot about factory farming. Even so, the key difference here is that brain function and intelligence are tied so tightly to the idea of human exceptionalism; that it is OK to enslave a horse but not a human, because humans have more capacity for autonomy, suffering, and so forth.
How precisely to draw the line is very much a matter of disagreement.