Not all shades of skins are the same within one specific demographic.
Unless there's also a way to accurately extract the specific hue, you will never get anything accurate.
Anyone that ever wore foundation can tell you that human skin has tones, undertones, different reflective qualities, etc.
Just look at https://www.temptalia.com/wp-content/uploads/2018/05/summer-... or https://cdn.shopify.com/s/files/1/0009/0000/5932/files/Shade... or this https://pbs.twimg.com/media/B_zp3U1XAAAk4Iz?format=jpg&name=...