My domain DNS records were pointed to the Fly app IP. When the app silently died, and support wasn't able to help they suggested me to launch a new app which meant new IP for DNS.