It's true that Markov chains are very limited in their capabilities. But one thing I love about them is that they are one of the simplest and most intuitive ways to write code that *learns* from input data.
If you're never written something that *learns*, try it out! Here's a very primitive one I wrote recently to explain the basic idea and explains it along the way.
https://github.com/unoti/markov-basics/blob/main/markov-basi...
This starts with generating US city names, and ends with generating text based on the Dungeons and Dragons DM guide.