I wish there was a way to completely avoid the app. I have a bunch of Aqara devices that are Zigbee and they never even talked to Xiaomi because I only connected them to my Conbee without ever installing any Xiaomi App or whatever.
I wonder how hard it is to add an ESP8266 to the lamps and just control via the ESP.