TLDR: Because tree-based models don't just outperform deep learning, they totally outclass deep learning on simple data.

But they don't scale with larger and more complex data. You cannot (realistically) make an LLM with XGBoost.

Kind of surprised how well Resnet and FT Transformer do though.