It's the 40nm process of the BCM2837 SoC in the Raspi3 that really makes it so [comparatively] hot. That's stone-age lithography there.
Modern phone SoCs are not only etched down at "10nm" (FinFET et al, making things seem smaller too), they also get to sink their heat into adjacent and highly conductive components like the screen and battery.
Raspi3 has air on one side, and a [comparatively] thick PCB on the other. Thermally speaking, they're in different worlds.