Consider CO or CO2 being elevated indoors, which is a real thing. Consider working next to an open window if the climate allows it.

But it's also often totally random to me, if something is uncomfortable (say my back hurts randomly that day from sleeping funny) it's distracting and makes it harder to focus.