There is no substitute for practicing with a native speaker who will not become frustrated/impatient/annoyed with you (like a friend). At a minimum, do two one hour sessions a week. Three is better and five would be amazing (assuming two or three different tutors).
Change your listening habits. Start to listen to audio in your desired language. Music, even podcasts. You probably will not understand much to begin with and the goal is to start picking out sounds, syllables, and word and phrase boundaries. Eventually you will recognize connector words, short phrases. Keep with it. Ignore those who say you need 95% knowledge of the words being said to understand. Your goal is not to understand what is being said completely but to train your ear.
Eventually you will realize correct grammar is what makes you intermediate level. But no hurry, mistakes are how you learn.
Good luck! Be patient with yourself. Language learning is not an automatic process after childhood.