I guess the other side got a good idea of the level of importance you had assigned the ongoing FaceTime call.
FaceTime is routinely used to just hang out with your family or buds, your presumption that doing other stuff is automatically rude just doesn't hold up.
The amount of attention given to a FaceTime call is not a measure of importance, thus the observation is unsupported.