I'm sure this makes it more difficult. Most mobile devices are locked and require some significant hacks to makes them boot an alternative OS. On top of that, each one requires a completely different kernel. There's currently no mainline support for most ARM SoC's, although I know that is being worked on.
> Is there no interest in the community?
I think this might be it. Most hackers are happy with Android. It's 'open-source' and they can run community-driven custom ROMs. Most Linux desktop environments suck on a touch screen anyway so there's not much incentive to install a linux distro.
Also, take a look at Arch Linux ARM if you haven't heard of it. It runs on a lot of ARM boards very similar to what's inside smartphones and tablets. It really should be only a minor effort to get that on phones and tablets but few are bothering to do it.