Maybe that's why it's called "imitation", not "learning"
Imitation learning is both imitation and learning. The difference between it and reinforcement learning is that the latter learns a policy for decisions based on rewards and the former learns to approximate observations as ground truth.