Turns out if you do a cute little hack, you can make
nateraw/musicgen-songstarter-v0.2
work on vocal inputs. 👀

Now, you can hum an idea for a song and get a music sample generated with AI 🔥🔥

Give it a try: ➡️
nateraw/singing-songstarter
⬅️

It'll take your voice and try to autotune it (because let's be real, you're no michael jackson), then pass it along to the model to condition on the melody. It works surprisingly well!

https://huggingface.co/spaces/nateraw/singing-songstarter

huggingface.co

Sing an idea ➡️ Music - a Hugging Face Space by nateraw

Bring song ideas to life