I, as a shareholder, do care. It isnt about moralism. Sony america lost their ceo because he was banging some 20yo as a perk to sign a contract with another media company and she got mad about it when her side didnt pan out (no acting roles).
It is bad for business. Thats all. Him doing this is bad for Nvidia and bad for shareholders.