True. Math nerds get excited by the ratios, roots, and groups, but all of that is a rabbit hole - useful for DSP code, but it will do nothing to help you write memorable music.
The book does not assert that to write memorable music you only need mathematics.
Knowing how to count beats and bars can be helpful when writing music, as can knowing how string lengths are related to notes when playing a stringed instrument.