It ships as a dual booting computer with a dedicated gaming mode - it doesn't corral your behavior into a "correct mode of usage". You can freely program and modify it. The haptics are great, it's not as big or unwieldy as people made it out to be, and it's full of "nice touches", if you dig into it.
I laughed when I realized I'd been toting it around with me like I did with my GameBoy as a kid, because I haven't even "gamed" since Dark Sous was big, yet I've been finding myself constantly thinking about things to do with it. And if you love it, you can always upgrade the storage.
My gut reaction is that I don't agree with you, but I can't immediately put into words why. I think it's possibly that I view a "console" for gaming as a combination of a form factor and development environment and this seems to fit that bill.
I'm interested to hear the other side though.
Otherwise, are stationary PCs custom built for only gaming, such as those used at e-sports tournaments, consoles? They don't have the same customized software stack, but neither does the Deck in comparison to a PS5, imo.
Is the ROG Ally a console? What if I load SteamOS 3.0 on it? Is the PS3 with Linux on it still a console? Are gaming-focused phones consoles? They have vertically integrated hardware and software, and are made with gaming as a focus yet can be used as somewhat general purpose devices, just like the Steam Deck.