Anecdotal reports from recreational use (higher doses than medical) are that the dissociation, vertigo, and double vision only happen while you’re high, not after it wears off.
The disassociation is often a desired effect, it can be incredibly enjoyable.
It’s like saying that a side effect of drinking alcohol is feeling drunk.
For better or for worse.