I 100% agree with you. I'm not here saying "it's not a server unless it has more than 30 cores rabble rabble rabble." There's a spectrum of server hardware available ranging from stick-it-in-a-closet micro server to full fledge DC grade rack server.
An Atom (C series) is a server (albeit a microserver). I have no issue with this at all. Xeon D chipsets go all the way down to 2 cores, I still recognize it as a (micro)server. Both CPU families are labelled as servers by Intel (that's not to say Intel has the final say in what a server is or is not.)
Celerons lack the feature sets to be called a server from a pure hardware perspective.