I.e. never? I mean, I can picture making phone calls or dictating SMS by voice with a smart watch, but people are not going to be browsing the web or taking pictures with a tiny wrist device when they already have a 5-6" inches display device on their pockets, and almost no one would ditch the latter for the former if they had to choose.
I think it's likely that smart watches will continue to be niche devices for the foreseeable future, at very least until someone figures out a killer feature that sets them apart from smartphones.