What's inconceivable about the lyrics being generated?
A single song's lyrics easily fits into the context window of virtually any LLM, and with some of the bigger and better ones (Opus) you could probably feed it every known song's lyrics in your desired genre before asking it to create a new set of verses.