But it does. How many grains of send form a heap? How many atoms form a fluid? Is it something a particle or a wave? The line can be drawn depending on specific problem, on how useful a heap/fluid/particle/wave model for this specific application.
A label (abstraction) allows us to bring corresponding tools that were developed for it. If you can count trees then the same math can be useful to count people.