Came here to say this. The fidgets are known to help with focus and thought, so if I can't fidget, I work noticeably more poorly. It's very difficult to notice them already.
Oddly enough, I can be very helpful to others in an open space, but I've never managed to get my own work done.