Soon (hopefully) the Pi 4 will be able to completely boot off USB 3.0 devices; right now you can partially boot off an external volume, but /boot still has to be on a microSD card.
Though in my testing, it's still not a night-and-day performance difference, if judged by the Pi 3B+. I am not sure if the Pi 4's USB 3.0 port bandwidth will give that much of an improvement.
It would be quite nice to have any form of drive supported more directly, NVMe, m.2, whatever.