Cool to see this upvoted here, though I will say this is fairly deep down the weeds — if you’re new to the topic of analyzing trained neural networks neuron by neuron, I’d suggest starting with our introductory article: https://distill.pub/2020/circuits/zoom-in/