The OS kernel wasn't so stable relative to anything else at that time including embedded Linux, had 32MB/process hard RAM limit that ruled out WebKit, and also the scheduler was badly designed that the UI frequently stuttered or locked up. The UI also did not utilize GPU for general UI rendering(common at the time; made an obsolete idea by Apple), tasking CPU and its bus for everything.
The device I had came with a stylus shaped like a handstrap charm that doubled as the reset button pick. Isn't that inexcusable by modern standards? Everything back then did have a recessed reset button hole, but not everything came with a carry-on tool to poke it. The WM device I had did. Which I didn't use as lifting and reseating the battery was faster.
It totally deeply horribly sucked for phone-like devices. I used to have one from work. HTC Touch Pro 2. It had a glossy horrifically slow overlay that made things even worse but either way it was a UX nightmare.
Even on my Dell Axim it wasn't great though not terribly bad either. For the time it was ok, and I read some books on it and played some games with the likes of ScummVM. But as a phone you use every day brrr.
The later windows phone solved a lot of issues and it was very well liked, Microsoft just didn't give it enough time to actually take off. Some people still pine for it today.
For some reason they thought the tablet would be the next major computing form factor rather than the niche it has become and they were afraid losing it all to Apple. Kinda can imagine that but I never understood why the desktop had to suffer for it.