I strongly disagree with you there. In fact, I'd say the exact opposite.
The experience of using the product has always been at the very core of Apple's design philosophy. The entire desktop metaphor, include the Trash, the files in folders, etc. is about simplifying the user experience with the computer.
The fact that anyone can just pick up an iPhone and pretty much immediately know what they should be doing, without reading a manual, tells you exactly that usability has been so thought out that it has become invisible. You just do what you want to do, without having to think about how to do it. So, it's the embodiment of the Steve Krug "Don't make me think" mindset: usability is design.