All CPUs with MMUs use them, so Linux has to handle them.
[1] http://infocenter.arm.com/help/index.jsp?topic=/com.arm.doc....
So when you say the Cortex-M4 does not have an MMU, you're categorically wrong because it can and does have one on Ti J6 chips.