If cpu softmax were limited by memory bandwidth, then these vectorization optimizations wouldn't improve performance.