I had this issue too, even before the pandemic. In fact back when I was looking even if there were Elixir job postings they often strongly preferred a Ruby/Rails background on top of that, which I didn't have.
I just decided it's one of my hobby languages. If a job comes out of it in the future, that's awesome.