The permission popups are only needed if you want to gather and store data. And why do that if you don't want to use it?
If you're really worried you can write a simple privacy policy stating your server stores some stuff like the client IP etc. (so you can do something like, block abuse) and then follow that policy to the letter by not doing anything else with the data you gather.
It's not hard.