How's that? All my contacts can be stored locally, photos backed up both on my computer and to a separate service plus iCloud, it's pretty easy to set up Dropbox or Box in-place of iCloud Files. Apple Wallet is handy but it really just stores digital copies (over-simplifying) of my physical cards, any of which I can request a replacement for outside Apple.
I don't use Safari but if I did any of its bookmarks/history are easy to import into other browsers.