Could you clarify what was meant by harsh?
The HDMI PHY[1] differentially encodes either I2S or S/PDIF (from SoC). This is a lossless digital-to-digital translation, which suggests that audio being a bit harsh is either a consequence of precise emulation of the NES APU[2] or something wonky with the speakers you're using.
I made the assumption that by harsh you meant dissonant sounds of a relatively high audio frequency, which would make sense given how the 2A03 APU synthesizes audio, but wouldn't make sense if you're suggesting that a dead simple high-pass filter would resolve the issue.