MrCheeze··on Stable Audio: Fast Timing-Conditioned Latent Audio DiffusionIt has been done - first by OpenAI (MuseNet, which is no longer available) and later by Stanford (Anticipatory Music Transformer): https://nitter.net/jwthickstun/status/1669726326956371971