A thing many overlook are restart it. You cannot just go and `systemctl restart` it, once that occurs, constant rebalance happenning because it puts the load to the rest of system and eventually bring them down, all around :(. That make it harder to operator in K8S when it needs time to detach/attach volume, plus the overhead of overlay network.
So I myself didn't know about a perfect tunning. But the log search on Kibana is super helpful though.
That's why I kind of sold on this Loki thing. I have a good feeling that software in Go tend to require less config/tunning compare with Java. Eg, InfluxDB.
> Some other days, you wonder why we moved away from syslog senders and text files...
I wonder the same. I actually like to grep log with tail more than a crappy web ui like Kibana, Sumologic etc.
Tailing log in a webui is clunky.