You are. The brain actually responds to CO2 concentration, not oxygen concentration. Your metabolism turns O2 and various hydrocarbons into CO2 and water, but many of the feedback loops in this process that mediate how your body metabolizes are based on the CO2 concentration; so even if O2 is unchanged, if you body detects more CO2, it will start metabolizing less.