I think that is definitely a part of the thinking. But also SD cards are not known for their reliability. I’m sure there is a conscious decision to prevent the poor user experience of having their phone’s SD card crap out on them.
As with anything, there are always lots of 'reasons', that are not the reason.
Not surprising, as flash has a limited number of write cycles, and the FTL for SD cards probably optimises for unexpected power loss instead of low write amplification or performance --- they have almost no cache RAM, after all.
Something tells me the reason they don’t appear on regular phones is similar to the reason Apple started soldering RAM onto motherboards, and many other PC makers followed. i.e. the reason they tell you is the reason isn’t the real reason.