This is one of those cases where the hyphenation really matters.
A Japanese learning app would be an app in or by Japanese for learning things.
A Japanese-learning app would be an app for learning Japanese.
A Japanese learning app would be an app in or by Japanese for learning things.
A Japanese-learning app would be an app for learning Japanese.