Also, because they are focusing heavily on the RL part of the modeling. They obviously have obscene amounts of available compute, but that is not their competitive advantage.
I would say having an obscene amount of compute is definitely a big competitive advantage, especially over a lot of small academic research labs.
> The values of all hyper-parameters were selected by performing informal search. We did not perform a systematic grid search owing to the high computational cost.