It definitely sounded "like music", but none of it is what a human would produce. There's just something off.
It definitely sounded "like music", but none of it is what a human would produce. There's just something off.
- The rave music sounds great. But that's because EDM can be quite out there in terms of musical construction.
- The guitar sounds weird because it doesn't sound like chords a human hand can make on a tuning nobody tunes their guitar to - with a strange mix of open and closed strings that don't make sense. I think the restrictions of what a guitar can do aren't well understood by the model.
- The disco chord progression is bizarre. It doesn't sound bad, but it's unlikely to be something somebody working in the genre would choose.
- meditation music - I mean, most of that genre may as well just be some randomized process
- drum solo - there's some weird issues in some of the drum sounds, things like cymbals, rides and hats changing tone in the middle of a note, some of the toms sound weird, it sounds like a mix of stick and brush and stick and stick and brush all at the same time...it's sort of the same problem the solo guitar has where it's just not produced within the constraints of what a drum player can actually do on an instrument made of actual drums
- sound effects, all are pretty good, a little chunky and low bit-rate or low sample-rate sounding, there's probably something going on in the network that's reducing the rate before it gets build back up. There's a constant sort of reverb in all of the examples
I honestly can't say I prefer their model over some of the musicgen output even if their model is doing a better job at following the prompts in some cases.
All of the models have a very low bitrate encoding problems and other weird anomalous things. Some of it reminds me of the output from older mp3 encoders, where hihats and such would get very "swishy" sounding. You can hear some of it in the autoencoder reconstructions, especially the trumpet and the last example.
However, in any case, I'm actually glad in some ways to see the progress being made in this area. It's really impressive. This was complete science fiction only a very few years ago.
And I would say that there is also background noise from time to time, at some point I heard some noise akin to voices. Maybe it is some artifact caused by the training data (many drum solos are performed exclusively live).
Suno do have an open source repo here that presumably uses similar tech: https://github.com/suno-ai/bark
> Bark was developed for research purposes. It is not a conventional text-to-speech model but instead a fully generative text-to-audio model, which can deviate in unexpected ways from provided prompts. Suno does not take responsibility for any output generated. Use at your own risk, and please act responsibly.
I've generated probably >200 songs now with Suno, of which perhaps 10 have been any good, and I can't detect any pattern in terms of the outputs.
Here's another one which is pretty good. I accidentally copied and pasted the prompt and lyrics, and it's amazing to me how 'musically' it renders the prompt:
https://app.suno.ai/song/d7bad82b-3018-4936-a06d-8477b400aae...
Here are a couple more which are pretty good (i use it primarily for making fun songs for my kids):
https://app.suno.ai/song/a308ca8a-9971-47a3-8bb3-a95126ff1a8...
https://app.suno.ai/song/3b78a631-b52a-4608-a885-94f2edc190b...
And this one's kindof interesting in that it can render 'gregorian chant' (i mean it's not very good): https://app.suno.ai/song/0da7502b-73cf-4106-88e8-26f4f465a5f...
But this is one reason it feels like these models are very similar to text-to-speech but with a different training set
It generally does a good job, but I have noticed it's fairly common in a second chorus for it to ignore the direction and instead use the same lyrics as the first chorus
There's no such thing as "artificial music" - at the very least, not since electronic music has become mainstream.