I replaced Photoshop with Gimp years ago, but I still find Gimp incredibly painful to use. It accounts for a tiny proportion of my software use, but a massive proportion of my swearing. I use to think it was just down to being familiar with Photoshop, but I think I can only excuse it on that basis for so long.
Some parts of the UI are very rough to work with. The gradient editor, for instance. Sure I can use it to make any kind of gradient I want, but navigating your colour stops through a pull-down menu? Then also not marking the current colour stop in the preview gradient, means you can't see "where you are" in your gradient as the pull-down is collapsed. Makes adding colour stops very unintuitive cause you won't know where they'll appear (before or after the current point) ... there's more, but it's all this unnecessary friction for something that should be quite simple, and has been done in various better or worse ways lots of times before.