Agreed - I made the transition away from explicitly coding just over a year ago, and dealing with people, especially recruiting, was definitely harder than anything I'd done before.

One year later, it's only about as hard as programming, but I'm now on to a new thing that's harder than anything I've done before: managing.