The one that matters is missing: how do you get the best random seeds? /s
In the days when Sussman was a novice, Minsky once came to him as he sat hacking at the PDP-6.
“What are you doing?”, asked Minsky. “I am training a randomly wired neural net to play Tic-Tac-Toe” Sussman replied.
“Why is the net wired randomly?”, asked Minsky. “I do not want it to have any preconceptions of how to play”, Sussman said.
Minsky then shut his eyes.
“Why do you close your eyes?”, Sussman asked his teacher. “So that the room will be empty.”
At that moment, Sussman was enlightened.
Proper methods of bias analysis are network compression or random surgery, and expanding test data set. Proper methods of training are robust to varied initial states.
If you randomize your seeds, you do not deliberately bias your model. This does not mean your model is unbiased.
There you go.
pumpkin 3.14
Normally I prefer apple, but during the holidays you must adjust.