It is the part of softmax layer, but not all the time.