I rather dislike that weird side ribbon thing. Some time ago I thought I'd try and build a version without it, but that wasn't as easy as I would have liked. Maybe I'll give it another go.
It's as simple as right click it -> Activity Bar Position -> ...