This requires a context switch which is expensive in it's own way. Read the article, it covers this pattern pretty well.
An interesting experiment would be to find the switch-time threshold for a wide range of developers.
Typically I don’t rely on a full build for getting things accomplished, and not CI if I can help it. Local, incremental, and minimal path to feedback is what I aim for.