The evidence seems to point to "in matters of taste" being a much later addition: https://www.snopes.com/articles/468815/customer-is-always-ri...