You are not mistaken - the session selector shows the overview of all windows from given session. Very similar, but not full screen