Our pipe-wielding example will just find another victim without a helmet. You can always find something a victim could have done differently, the only common thread is the perpetrator.
Also legality isn't a proxy for morality. Slavery was illegal. Some societies allowed cannibalism. What Soros did had a human cost and the fact someone else might have done the same financial alchemy had he not doesn't excuse it.