That's really my biggest problem with Circles in their current form. They're being themed as analogs to how we group people in real life, but in reality we're still network administrators in that we apply permissions to things that we only want certain groups to see. Admins have netgroups (netgroup = users and/or groups) whereas we have no form of inheritance/hierarchy/overlap to make things easy to remember.
That said - I love Circles as an interface/vocabulary paradigm more than lists/groups, and the UI is very well-executed.