I can confirm it's a native option in Sierra. I have not installed Karabiner. Actually, from their website: "Karabiner does not work on macOS Sierra at the moment."
Sure enough, this is new with Sierra. El Capitan doesn't support it. Finally! I was tired of Seil/Karabiner/whatever else constantly updating itself and changing its name, just so I could remap caps lock to escape.