I can't think of anything that neural nets can't beat, except small tabular data with boosted decision trees. Can you give some examples?
1. Collaborative filtering based on a sparse dataset of implicit interactions.
2. Many time series applications.
Regarding time series, don't everyone moved to attention based models?
Not challenging your answer, just curious. I work mostly with Graph NNs and quite a bit out of touch with the rest of the field.
> also, DL generally requires more data whereas you can get by with ML on less data if you have domain knowledge