Perhaps it's possible to have the design meeting with a smaller set of invitees? Does everyone really contribute in the design sessions, or is it mostly people silently listening as a few dominant voices carry the meeting forward?