You can, but apart from calling & web browsing, it's not that useful, in contrast to a windows machine (i guess you probably can't use the windows store)
Pretty sure the same stands for Android.
Sure I would say this would make it more of a feature phone but the device itself is quite usable without an iCloud account.