The beta docs are just that, beta. They're being written as a replacement for the current ones but aren't yet stable. So asking "why is that the case", the answer is simply that they're rewriting old docs and aren't done yet.
Also as a newcomer to Next.js, you start off, the tutorial seems great, then midway they announce they are switching to a new system and it's hard to be bothered after that.
Oh no, I was thinking of sitting down to learn next.js. What is this midway switch you mean? Isn't it brand new?
NextJS 13 introduced an app directory which is different than file based routing (to some extent). But it's till in beta so you don't have to worry about it right now.
Indeed, the pages directory will continue to exist for awhile. You don't need to learn app yet.