However, atmospheric CO2 concentration would not stay constant after emissions stop. It would go down slowly, mainly because it would continue to dissolve into the oceans. This effect cancels out the above point. Which is why the IPCC says that "The global temperature will stabilise when carbon dioxide emissions reach net zero."[1]
Unfortunately, stabilizing temperature does not mean that nothing else changes. The stable higher temperature will still mean that glaciers will continue to melt. Sea levels will continue to rise. Oceans will still acidify further.
[1] https://www.ipcc.ch/2022/04/04/ipcc-ar6-wgiii-pressrelease/