Exactly the same here. I've considered switching from Android multiple times and the two things that always stop me are notifications and the keyboard.
No long-press punctuation, no switch.
I also can't trust Apple to let 3rd party keyboards work smoothly everywhere, so that's not really an option I'm willing to take the risk on.
Doesn't solve the notifications either.