That always struck me as lame. If someone that well off wants to eliminate that decision, then just have a professional clothes person create clothing matches. 'A' goes with 'A'. 'B' goes with 'B'.
What it really is, is someone making a statement about how important their decisions are.
Lots of well off people still wear interesting clothing.