I strongly recommend the book by Sutton and Barto https://web.stanford.edu/class/psych209/Readings/SuttonBarto...