I agree with mkagenius, I've played around a lot with deep learning and like physics it suffers a lot from unnecessary jargon that hides relatively simple concepts, for example this random quote:
>ReLU stands for rectified linear unit, and is a type of activation function. Mathematically, it is defined as y = max(0, x).
Now everybody could just use plain English - if you have a negative number, set it to zero, in all other cases, keep the number - I don't know why someone has to use 'rectified linear unit' to describe this simple operation.