I think it would both be me until it started to drift, which would be almost instantly.
That said, I wonder if that offers a possible way to 'transfer consciousness' between a human and their robot copy - link both brains together and then once synchronised (whatever that means), shutdown the biological half. Like a sort of extended Ship of Theseus idea.