The upstream router doesn't care, but the closest router to your server needs a mapping between IPv6 address and MAC address.