You're not the only one. I'm this way too. However, I can listen to music while doing system admin stuff but for anything else I need absolute silence.