See mixture of experts. It’s likely what chatGPT does in the backend.