I’ve fed chatGPT the specs for some toy languages that it didn’t know and it generated code in them no problem but did a lot of filling in the blanks for what it thought would be in the standard libs.
Something more interesting to think about is what would a programming language designed FOR llms to use look like?