I've found that a problem I've had is that a "2 minute task" is sometimes, for me, estimated to be a 20+ minute task.
When I actually got out a watch and timed it, I was like "oh shit, that was not even a fraction of my estimate".
So it's the estimation, not the actual task length/difficulty that is sometimes a problem for me.