Investing in centralized logging and alerting can give you the raw data for your dashboarding vision. I'd start there.
I want a control panel. Complete with blinkenlights and switchgear that goes “click” and has satisfying detents.
It sounds like you would find some comfort in and around these devices.