Out of the box settings, ugh.
Full second to parse jquery, 1/2 for jquery, 1/2 for jquery migrate. Something called wp-emoji-release.min.js is taking another 396 ms.
And this is after repeatedly visiting the page in my browser. I thought the browser was supposed to cache stuff? Heh.
Then again, according to Chrome, the page only took 1.4 seconds in total. I'm wondering where the remaining 4 seconds of me staring at an empty browser tab is coming from. :/
Then again, switching pages on my WordPress admin page takes ~6 seconds, so I think there is just a significant probability than my VPS has miserable performance.
Edit: Installing a caching plugin makes the page load not as horribly slow. It is at 3 seconds now, which is still 2 more than I'd like, but at least acceptable.