Wearing my architect cap...
There are four types of applications in that respect:
1. always disconnected (e.g. calculator)
2. occasionally connected (e.g. email client)
3. occasionally disconnected (e.g. messaging client)
4. always connected (e.g. trading terminal)
First architectural task I am doing when have given an application idea is its classification using these models.
Each particular case requires its own storage/caching approach. "Offline first" is too broad.