It feels to me like you're redefining what a number is to be very different to what anyone with a maths background would say a number is. Essentially you're saying that neither e nor pi are numbers?
But the concepts are useful, and the symbols have meaning. The article mentions normal words having different meanings in mathematical language, and that impacts even every-day use of maths.
There is a countable subset of the reals called "computable numbers". We only ever use a subset of computable numbers in real calculations.