I hate to do this, but it's "grammar".

Not that I'm calling you an idiot, you have a very fair point.