Of course the only me that exists is right now. In no feasible reality would I ever shake hands with me from yesterday or me in the vat. Nor would I ever shake hands with me in a robot, just a robot that thinks it's me. Even if those other entities exist they are not me.