It also ignores the question of what economic growth is. Infinite economic growth does not mean infinite potatoes. Infinite economic growth means infinite increase in perceived worth of stuff we make. That's eminently doable. I mean, growth has shifted to services long ago.
We can't make infinite potatoes, but that's not required for infinite growth.