There are already methods to do that in neural networks, it's called "pruning"

https://en.wikipedia.org/wiki/Pruning_(artificial_neural_net...

and, yes the article also mentions that it happens in mammal brains.