Goldman has been accused of an assortment of misdeeds, including a general decline in ethical standards, working with dictatorial regimes, cozy relationships with the US federal government via a "revolving door" of former employees, insider trading by some of its traders, and driving up prices of commodities through futures speculation.
Wikipedia has a whole separate article about their controversial practices.
https://en.wikipedia.org/wiki/Goldman_Sachs_controversies
(Disclaimer: I don't see this as a reason to avoid the Apple Card, but someone should play devil's advocate here.)