Caps Lock is stupid. How often is it actually useful? It capitalizes your letters, but you still have to use the shift key to make exclamation points, question marks, and most other symbols. Might as well just hold down the shift key for everything.
So instead, change your Caps Lock to another input action. On a Mac, go to Preferences -> Keyboard then click “Modifier Keys”. Use the dropdown list of actions to change the “Caps Lock Key” to do something else. I like turning it to “Control”. This is particularly useful on Macbook keyboards when the “Fn” key is where the “Control” key should be.
You can always change it to something else. Give it a shot. Make the Caps Lock key work for you!