I'm trying something similar with Japanese via Ghost of Tsushima (finally started playing it this month). I've lived in Japan 10+ years, only speak conversational Japanese....so far I don't think I've absorbed any linguistic improvements from using the game. I might just need more time with this style of immersion.