If you’re building a static site - meaning, a site which does not have any forms which require backend functions - you should use a static site generator. If you’re not building a static site, I recommend starting with a static site. It’s just a lot less to keep in your head as a beginner.
My recommendation is Astro. I like it because it makes it easy and straightforward to create a static site. And, you will also learn JavaScript along the way, without building out a node backend or even anything on the front end.
But, if you really want to learn, I recommend noting. Yes, nothing. Just HTML files in a folder, a css stylesheet, maybe some JS files, and a web server. For deployment, you don’t need a web server config or a VPS. Just use cloud flare pages, link it up with GitHub, and boom, you have a static site.
Don’t be intimidated. If you do just HTML, you can learn a lot and you get the nitty gritty. You understand how the site actually functions from start to end.