Beam search is like a breadth-limited breath-first search. This is more akin to a depth-first search where you give the model the ability to backtrack.