Why bother with this instead of sending a 3d model and just sending the position of a few control points/bone animation.
It's not a huge benefit over what you're suggesting (realistically, when are your bandwidth constraints ever that strict?) but it's an interesting idea.