When you hold your breath, oxygenated air remains in your lungs. This allows you to maintain consciousness for potentially a minute or two.
In a decompression event, the air is sucked out of your lungs. The air that remains has a low O2 partial pressure, and so oxygen can leak from your bloodstream into your lungs. As such the body's normal mechanisms for storing oxygen simply don't work.