ParentFull threadlopuhin·No, they don't need a pre-trained model, they start from scratch. Also it's only the approach which is common between modalities, they train them separately.View on HN