I went from zero Japanese to JLPT N2 in just a few years and I attribute a great deal of that to Anki. However, I was also frequently talking in Japanese, and reading/writing in Japanese. I was constantly using what I was learning.
Maybe an analogy is, Anki is like steroids, but you still need to go to the gym. :P
I don't study Japanese at all anymore and I have very little exposure to the language. But I still do my flashcards. I've noticed my recall is excellent when doing the flashcards, but if I see some Japanese written on a billboard, or think to myself "how do I say this again...", I struggle to recall even things that are in my flashcard packs.