One of the concepts twelve factor pushes is that you should be able to release your source code right now without compromising any credentials.
Basically, you'd have a git repo for code, and a separate git repo for environment scripts. I've seen organizations use a whole separate infrastructure for config, but that always seemed like overkill to me.