Note also there are many other repositories available in https://github.com/openai from various papers & projects, such as https://github.com/openai/baselines.