Bad usability and a high learning curve are not the same thing. A high learning curve is what makes people "new to FOSS" have difficulty with emacs/vim, not a lack of usability.
And Gnome is also a bad example, since it is both usable and has a minimal learning curve. At my last job we set up a crowd of 30 fashionistas (no tech background whatsoever) using gnome with no real issues. Several of them also used inkscape with little difficulty.
I know GIMP, Emacs and VIM may be in that field (although I do not agree particularly with Emacs and VIM), but there are so many free software projects used everywhere, and these are just examples; you cannot generalize from that. There are also plenty of examples of free software with good usability, and I have never seen a broad study of different free software to study their poor usability.