Not really, because there's an implied capacity for offsetting carbon. That's what it costs now, but as more people participate, the cost will undoubtedly go up.
Mass production is a thing that brings costs down, so some of the carbon offset programs could take advantage of similar effects.
You're definitely right that some of these projects aren't infinitely scalable though. There are only so many gas stoves used in northern Uganda to be replaced..