Fully agree. Limiting the networks which can access your server will help, e.g. limit access to just your local provider or your workplace and you'll see no attempts from Brazil, China, ... unless you are located there, of course ;-)
Used one or the other every now and then in the last 10+ years and still have my attackable footprint small the rest of the time.