You're writing it wrong -- it should have a comma in there to denote the pause: “Would you like the red shirt, or the blue shirt?”
Are you also speaking it wrong? The part before the pause should be spoken with tone going up, and the part after with tone going down. If you're not pausing and changing tone, then the correct answer is either "yes" or "no", or repeating the whole thing back to mean "yes".