The definition of rape hinges upon the detail of consent. So the reality is that many rapes are not particularly violent. I realize people don't like hearing that but men are typically bigger than women and the socially expected thing is for men to be the pursuers. So in cases of, for example, date rape, men often do not realize they committed rape unless they are charged with it. There is often alcohol and miscommunication involved.
So it really doesn't help to understand the problem space to characterize rape as a "violent" crime and rapists as "violent criminals." That is often not how it happened at all.