This is not something you can train on a regular AWS gpu-instance without racking up millions of dollars in bills to my knowledge. Dataset isn't an issue its a capex issue.
Luckily, training from scratch will hopefully be obsoleted by fine-tuning - if someone else releases a generally capable model then you can turn that into another one for lower cost.