PLE as well! https://github.com/ntasfi/PyGame-Learning-Environment

(disclaimer I'm the author)