I'm certain you didn't mean it this way, but it is ableist to assume that because you don't need distractions that others don't. Some people living with ADHD, intrusive thoughts, autism, etc. actually do sometimes need a distraction.
It’s like telling someone with depression/anxiety to “get over it”.