Impressive. Especially being able to tackle any public API such as MS Word. GDB's point about Codex as an instrument itself for interacting with machines directly means that program synthesis isn't really the endgame. Codex + an API for the web is a virtual assistant. Booking flights, ordering pizza as simple as human speech.
Also, Triton for GPU Programming looks pretty cool ;)
https://openai.com/blog/triton/