Just delete the app from your phone. Check the web app once or twice a week if you want. You'll probably realize there really isn't much to be gained from checking instagram everyday.
My phone's ROM has Facebook and Instagram baked in. Unless I trust some unknown person's custom ROM, I'm stuck with Facebook properties doing god knows what on my phone.