Just thought I'd share my experience with this, since I had a similar problem.

Spinners make it look like the app is taking ages to load data, even if it's not. If you delay showing the spinner until around a second of loading, it makes things feel a lot faster.

The user doesn't need to always know when the app is loading data until there's a significant pause and they need to know stuff is happening.