One funny observation is that while LLMs are great at coding, but they absolutely suck at generating content for themselves (or other LLMs).

They are truly horrible at generating docs, prompts, knowledge bases, memories, etc.