Maybe technically LLM can be converted to an equivalent Markov Chain.
The problem is that even for modest context sizes the size of Markov Chain would by hilariously and monstrously large.
You may as well tell that LLM and a hash table is the same thing.