Losing physical work won't be detrimental, it's something no one likes and no one is particularly good at, losing creative work would be but it doesn't look like we are particularly close to creating ai, and when we create it we'll find some way to stay at the center of it by either creating devices that augment our brains, changing our brains to be as good as the ai, or simply uploading into computer and becoming part of ai.

In any case there is so much work in science, that we should be happy for every human that is freed from physical work.