I gave the timestamp where they start talking about the problem they are trying to solve using transformers. As you said it is around 1hr mark