From the many people I have asked this question, I think the disconnect between toilet phone users and us is the availability of "Alone time".

Specifically no matter what you do in your house/work for some there is always low key chance of someone bothering you. This is not the case when you appear to be using the toilet.

Still seems weird to me though.