Or instead of analyzing the model we could analyze the training data for biases. Most bias comes from data.