Taking the carbon from the atmosphere will always be more expensive than from some carbon-rich rocks that form a huge fraction of the Earth's crust.
In fact, our most effective ways to take carbon out of the atmosphere today all involve a step of letting some mineral turn into one of this carbon-rich ones, and extracting it from there.