This is awesome! There's a lot of interesting things that can be done with just the level of sequence generation AI we currently have, transforming the real data into a format for it is the most difficult part, I think.

This similar project from a few months ago does Mario level generation and discusses the training data sequence creation in greater detail: https://medium.com/@ageitgey/machine-learning-is-fun-part-2-...