Hardly any reason to return to the emperor. To quote Wikipedia if I may:
> The Records of the Grand Historian says he came to a place with "flat plains and wide swamps" (平原廣澤) and proclaimed himself king, never to return.
> Ancient scholars credited Xu Fu for being the founding father, and catalyst of the development of ancient Japanese society.