I simply can't trigger a downward diagonal swipe on my phone. It starts immediately as a horizontal swipe, and then the downward component scrolls the whole game area downward, while not affecting the swipe angle.
Even if I start with a downward swipe, it treats that as a scroll action, not a swipe action.
This is in the tutorial. FF on Android.
OP, have you considered making each level a non-scrollable page?