For what it’s worth, I’ve been using the Apple Card pretty much exclusively for about a month and a half (in a leather wallet, and I only wear jeans), and it’s been nothing but enjoyable.
That said, my wallet's been accidentally through the wash enough times to lose a lot of the dye in the leather. Maybe it'll be fine!