You're not wrong. This is how the internet used to look like. Modern web layouts and designs evolved to be this way because they result in higher engagement metrics.
You don't need commercial interests to think about UX. The early web looked the way it did mostly due to hobbyism and undeveloped UX standards that we take for granted today.