Gas stoves need electricity for the starter these days. Maybe you can get a really old one with a pilot light.

It's far easier to provide a backup for electric appliances using a generator, than it is to store CNG onsite for gas interruption.