One of the few places where Angular falls down is its use of a single ng-view. This makes doing something as simple as a two column layout frustratingly more complicated than it should be.
Use ui-router. It allows multiple views and uses states for URL routing. It's a little tricky to understand at first, but once you internalize how states work it makes structuring your app very easy. Be prepared to rewrite parts of your projects multiple times until you actually get it.