I have a seen proper prompt translate commands into API calls. I imagine it’s doable even just with self hosted solutions like Home Assistant or homebridge.