You can largely blame Descartes for this notion.
It does however become very apparent when you read pre-cartesian authors that their views on the soul are off.
If you equate the soul with consciousness, it's obvious that a potted plant does not have a soul.
If you view it as the animating principle, it's equally ridiculous to say a potted plant doesn't have a soul, since it's so clearly growing.