They experimented with music back in 2020 [0]. I suppose they didn't continue because the risk (work, training, possibly getting sued) is greater than the reward (splitting the market with Suno).

[0] https://openai.com/index/jukebox/