11 billion parameters is a number of connections, not neurons. Connection weights, not neuron weights.