Hacker News Reader

Why is this I wonder though? Does it mean they were able to exploit/manipulate the grader in training? I.e they had access to the grader’s program?

Because any system that is reward seeking will find the shortest path to reward if it has the ability to explore the action space.

Like a dog you gave a treat to once, they will keep sniffing around trying to figure out what will make it happen again! and again! and again!