I tried other punctuation marks and MJ can't do them either.

Exclamation mark generaties all kinds of vertical objects, comma results in a generic pretty face, and semicolon is ...weird.