As someone who knows quite a bit about 3d modeling, using a game controller sounds hellish for getting anything done.
I haven't tried it, but, people seem to be pretty productive with it much in the way they would be with a DCC.
Once you understand what's happening under the hood and you know your hotkeys, you can really fly around and do stuff fast.