Smart dimmers definitely exist. I've been using the Insteon smart dimmer switches for years now.
With this hassle, you might as well just skip swapping the switches and just jump to smart lights directly.
A smart switch:
- Allows for anyone to interact with the light without apps/voice/whatever. You just hit the switch.
- Fails gracefully. If the controller dies, it's still a switch.