Some of that could be that these computers don't represent a shift in the wind - x86 remains the primary architecture for Windows. But I think that another big part of it is that every review of a Windows ARM laptop is full of caveats. Some programs will run slower, some programs won't run at all. Knowing which is which requires technical knowledge that a lot of people don't have, such as the ability to distinguish native executables from Java or .NET apps, or the ability to distinguish 32-bit programs from 64-bit ones.
Apple, on the other hand, really outdid themselves here. The story for most consumers is just, "It will run all your old apps, no problem." The worst-case-scenario story for a certain niche is, "Docker may be flaky until later this year."
IOW, the fact that "those buyers wouldn't have much reason to care anyway" represents an enormous accomplishment on Apple's part.