I think one thing that really confuses people is how user data is stored in the same space as system files, and can be manipulated in the same way. It's fine for people who know what they are doing, but many people I know are lost if their files aren't on the desktop or My Documents.
The average user doesn't need to look anywhere outside their home directory, or inside their application bundles. iPhone OS is a good start, but eventually Apple will probably want to provide a way for apps to share data, perhaps a common pool for app data. Or maybe a cloud data storage api which all apps use to store and retrieve files.
The sheer amount of data we have and how to organize that is yet another problem that is likely still waiting for a brilliant solution.