'Riffusion,' an AI model that composes music by visualizing it Share AI-generated music is already an innovative enough concept, but Riffusion takes it to another level by taking different approach that produces compelling music using not audio but images of audio.
we fine-tuned the model to generate images of spectrograms, like this:
funk bassline with a jazzy saxophone solo
The magic is that this spectrogram can then be converted to an audio clip:Really? Yup.
This is the v1.5 stab...
More