Same for me with Dzongkha: cha (ཅ) / chha (ཆ) and tsa (ཙ) / thsa (ཚ). I can aspirate the second of these fine, so that's not the problem. Hearing the difference is. This also makes it harder to remember the spelling as I mix them up all the time.
To be fair, I've only been learning for a short while (8 months or so) and haven't had much opportunity to listen to a lot of different speakers so perhaps this may get better.