"Work" is subjective. That idea only works if everyone's boss was as loving and forgiving as Jesus Christ (philosophically speaking).
I'm a developer and I mostly do my thinking offline. What I do on my computer is mostly translating my idea to code and consulting docs. Also testing and communication with the team. And all of this is already fairly visible without tracking.