For a long time user, usage of up/down/left/right should be punished!