Trains in general a great, why do people insist on sitting without any company in an expensive car which they even have to drive themselves?
In the same sense, parallelization (and computing on a GPU) are great when you need to perform the same computation on a huge number of data. When each computation is more independent, it might make more sense to perform it through the CPU.