I very much doubt anyone would disagree with this argument; however, it says nothing about the magnitude of the effect.
Also, just for the sake of argument, just because CO2 is a greenhouse gas does not mean releasing more of it will increase the temperature. For example, there might be an as of yet unknown mechanism where CO2 causes something to happen that actually decreases the temperature. Just because we do not know of such an effect doesn't mean it does not exist; it's a devil's proof.
Of course I don't actually believe this; it's just a thought experiment to show a flaw in your argument.