Democracy of descendant models that have been trained separately by partitioning the identified clusters with strong capabilities from an ancestor model, so, in effect, they are modular, and can be learned to be combined competitively.
Descendant models = models fine tuned from an ancestor on one particular domain, e.g. by partitioning your training data by subject or source
Democracy = some weighted mix of the descendant models is used to find the next token