You sound like you're old enough to have lived through the aftermath of 9/11, I'm glad to hear you didn't experience any racism due to your skin color.
For you there wasn't, and like you said earlier, there's no representative "brown person" experience. I have first-hand experience that's the definitely included an aftermath, one person stopped wearing hijab after being taunted, another started going by "Mo", and yet another - who's not even muslim - started dyeing her hair a color much lighter that its natural color to better pass as white.