We can simultaneously both blame rapists
and have effective safeguarding policy that minimizes the risk of rapists getting access to victims.
As an example, prisons almost always have a policy of sex segregation, with separate estates for each sex. The female prison estate is designated solely for female prisoners, and the male estate solely for the males. This physical separation safeguards the female inmates from male inmates, many of whom are very dangerous and have already raped.
In recent years, a handful of jurisdictions have experimented with allowing some male prisoners in the female prison estate, which resulted in sexual assaults and rapes of women prisoners, and even some pregnancies. The rapist men are to blame of course, but they were enabled in their crimes by a set of horrifying policy changes that put so many vulnerable women at a hugely increased risk.
It's not victim-blaming to point this out and insist that this broken policy be changed.