Exactly this. One example would be the difference in how pronounced reverb and delay effects are on headphones versus most speaker setups. Each ear is much more isolated, so the separate audio tracks for each ear don’t blend.