My immediate question:
How does this compare to simply maximizing the average probability (or log-probability) of the top-k paths predicted by the model?
How does this compare to simply maximizing the average probability (or log-probability) of the top-k paths predicted by the model?
Based on my skim of the paper, they don't. They select the top k paths based on the probability of the first token only.