I've found that I have to hold the watch very close to get it to work.

I'd think that they intended it to be on the same wrist as the hand holding the phone, but does anyone do that? I'm left handed and wear watches on the right wrist, and that pattern is practically universal in my experience.