How's Kubernetes working for you in production?

Asking because there are many components that are involved and we need to have a reasonable understanding to diagnose and fix an issue (in control plane or in worker) if it occurs.

What type of issues did you face? Any interesting stories you want to share?