Well put.

I also find that the nature of the musical content matters as well. For me, the most easily detected artifacts occur in complex material (e.g., symphonic or multi-tracked rock), especially when a lot of upper-bass and lower-midrange energy is present. Even so, the defects are slight.

As a disclaimer, I listen with extremely high-end gear and have access to high-resolution source material. It's possible that these effects are undetectable with normal kit.