What is MusicGen
Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.
Metaā€™s open source AI MusicGen turns text and melody into new songs
https://the-decoder.com/metas-open-source-ai-musicgen-turns-text-and-melody-into-new-songs/
Steps
- Go to Google Colab
- Change Runtime
- Run code
- Try to generate sound
step 1. Go to Google Colab
https://colab.research.google.com/
step 2. Change Runtime
Click Runtime
and select GPU
step 3. Run code
!git clone -b dev https://github.com/camenduru/MusicGen-hf
cd MusicGen-hf/
!pip install -r requirements.txt
!python app.py
Installing python packages will take some time.
If everything works properly, you will see something like this.
step4. Try to generate sound
If you click the link Running on public URL:
, you will see Gardio.
Now time to create your own sound via prompt!
It would take around 1ā€“2 minutes to generate a mp4 file.