There are plenty of senses in which infinity IS a number -- or rather, many numbers. See e.g. the Wikipedia articles on cardinal numbers, ordinal numbers, hyperreal numbers, and surreal numbers.
Yes, perhaps. But still it IS not a number.
Calling infinity a number is a "hack" done by mathematicians.