I feel like this statement is both obvious after spending a few minutes working with neural networks and completely useless in helping you build better neural networks.

It's kind of like saying, "Stripped of anything else, works of literature are compositions of words"