Depends if you want to go through the pain of not having easy access to other services. Most government forms? You need to go to the office. Paying bills? Get on the phone / go to the bank. Contacting your phone company? I hope you saved the piece of paper with their phone number. Need a local plumber? Pay extra for calling number information service / get someone random without seeing any previous feedback.

Internet makes a lot of things in life so much easier. I'm probably going offline for a while soon. But that means disabling mobile data unless I really need it. Internet can still be treated like a utility - just don't use it if you don't have to.