The implication being that this is the sole purpose of Yoga and there is no benefit in viewing it as yet another point of exercise? A hypothetical:
I have no interest in meditating for long hours, but practicing yoga and the "it helps you calm down" kool-aid that marketers promote actually helps me. It's not the "real thing", and I have an inkling that without the spiritual aspect I am missing out on a lot. However, I continue to practice it since I derive some benefits from doing so, and have no inclination to pursue the matter deeper.
^ I honestly see nothing wrong with the above scenario. I would accept someone who "dabbles" in Yoga without caring for its spiritual aspects the same way I accept someone who lifts weights 5 days a week but completely ignores nutrition. Sub-optimal? Yes. Should it be condemned? No.