It is correct. What is incorrect is to thing that symmetrical interface elements can have asymmetrical actions.
How would you like if turning steering wheel to the left would give left turn, but turning it to the right would stop the car?
If you want asymmetrical meaning, please, use different elements.