The third criteria of immediate feedback seems too stringent. In chess, feedback is often not immediate. If one were to run a reinforcement learning algorithm on chess with no human coded rewards, the only objective feedback would come at the end of the game (win, loss, draw).

Certainly the more immediate the feedback the better though.