It’s consistently going back in the context of the app you’re in.

If you want to go back to the previous app you can swipe from the left on the home indicator, or on older iPhones swipe from the left with force.