Yeah it's called a rare earth mineral because the concentration in ore is so low not because there's little of it in total.
It does unfortunately mean that you need to excavate a lot to mine it which is not great for the environment either (even though lithium is currently key to most renewable technologies)