I would be pretty distracted if there were people using pullup bars and doing pushups in my office...
If your office consists of just one big room where everything must happen, then pullups/pushups are probably the least of your distractions.
I guess it varies by company culture. If there was a pullup bar installed in the last startup I worked at, I'd still be there. Instead, there was an endless supply of beer so, meh.
As someone who worked in an office with these exact characteristics (complete with a pullup bar), I can vouch that in my case, the pullups were indeed the least of the distractions. The pool table next to all of us was the big problem. High quality noise cancelling headphones did not help at all.
Certainly varies, there is a portable pull bar that someone brought into our office that some of us use. It's been there for at least two years