I mean, if you want to get historical, the position currently occupied by the Caps Lock was Shift Lock on typewriters, which did the same thing as Caps lock currently does except it affected all keys, not just letters.
If I miss anything, I would like it if shift + caps lock, behaved the same as shift lock.