There are open datasets with that many image-text pairs. E.g. https://laion.ai/blog/laion-400-open-dataset/ There is even a dataset with 5 billion image-text pairs if you're feeling adventurous: https://laion.ai/blog/laion-5b/