This is a great idea.
Or make monitors have a USB device profile, or just use the serial profile and have a command response protocol (http rest) for query and setting configuration. Standardize this protocol.
Now all displays could be configured using external standardized logic. I'd prefer something over SPI, but either is really ok.