As an alternative, my Surface Pro 3 has an LED on the Caps Lock key to indicate on/off. It is a terrible keyboard otherwise, but perhaps there's other keyboards out there with this feature.
It saves you from typing a couple characters and then removing them, fixing the caps lock state and re-typing them.