Even with that it would be trivial to uniquely identify specific individuals. If anything that would be worse than the current situation as you would know certain attributes are definitely not spoofed.