I've seen flat structures (with a "boss" who is almost entirely hands-off) work very well for teams with several dozen people.
Where things seem to break down is at the next level, if the teams (and their "bosses") need to coordinate but can't reach agreement and end up blocking each other. Sometimes the teams lack global information while the bosses (for some reason) are not interfacing well.
I don't know if Valve still has their "wheeled desk" system for self-organizing teams, but I would like to hear from anyone who has experienced it.