Nothing wrong with retro-computing enthusiasts, per se. From the Linux kernel perspective it's about the architecture having maintainers and not causing pain for the rest of the kernel. The Linux m68k port is probably a good example of this, hard to see it having any kind of commercial value these days, and the maintainers are hobbyists. But with the Itanium port not having anybody willing to maintain it, bye bye.
Probably also helps that qemu has m68k support, so even if you love the idea of running Linux on your old Amiga, you can actually do the development on a mainstream platform.