Legalizing prostitution allows its workers to fall under police protection.
Illegality also leads to money hiding endeavors and tax fraud. Illegal sex workers are wary of setting up a real shop where they could implement security methods, or a guard to stand at the door in a brothel type operation.
Legalizing prostitution allows for better taxation, and less in the way of illicit venues.
I'm sure you're right in that every woman wouldn't turn to prostitution just because it became legal, but at least part of that should be attributed to the inherent danger of working in an illegal market with zero marketplace or police protections. We (hopefully) wouldn't see a huge spike in legitimate prostitution if it were legalized, but we would almost certainly see an uptick.