So does disabling password auth and using real keys.
My only experience with sshguard is via Google Cloud Platform. For some reason they enable it by default. Thus it locked me out somehow, making me spend an extra few hours wondering why SSH stopped working.
If you're that upset about auth logs, put SSH on another port.