I think that there's a few semantics we could quibble about, "wouldn't anything God did be natural by definition," and so on.

But I wholeheartedly agree with your first statement, and I find it profoundly frustrating that atheist tracts immediately assume that you do believe in a God of the gaps.