You misunderstand me. I am actually referring to katakana and hiragana, not kanji.

Just having to learn those first will stop a large percentage of people who would otherwise be able to learn to talk reasonably well.