Monitors used to have easy rotary buttons to adjust brightness and contrast. Though I don’t remember it actually being necessary that often. Of course, the monitors rarely changed location.
I was pleasantly surprised that HDR also means you can control brightness - it is all software I that case!
And the brightness keys on an external Apple keyboard work.
I prefer buttons on the monitor.
Using a game comtroller to change brightness is like driving a car from the back seat.
You could probably program keypad knobs like these to do the same: https://m.media-amazon.com/images/I/71s7PGYBkkL._AC_SL1500_....