For the people who answer this, I'd like to know if they booted from an sd-card or ssd-device as well.
I noticed a huge difference in the responsiveness when using my Pi 4 (only via ssh and with a terminal) for some machine learning jobs after I switched to boot from an external SSD.
For Pi4s made in the last couple of years, booting from ssd seems to be a built-in feature, without any need for flashing anything on the device first, which held me back from doing it earlier.