In fact it's even more vacuous ("nothingburger") because sometimes it's not even clear which way the person means it; if I say "I'm one of the only people to do a handstand on a Thursday morning", do I imagine that I'm in a large group or a small one?
[Edit: this paragraph added to respond to post below saying I'm not going to win, which was edited out and I couldn't respond to for some reason.] I'm not trying to "win" any more than I would try to tell people that literally isn't a synonym for figuratively; I know that ship has sailed. That doesn't mean I'm not allowed to say it doesn't make sense, and I'm very aware that people get extremely angry about it for some reason, as if it's a personal affront. Not everyone has to buy into the cargo cult of descriptivism (particularly in the face of absurdity), differences of opinion are still allowed :)