# Create a pop music Transformer

**URL:** <https://discuss.huggingface.co/t/create-a-pop-music-transformer/11526>\
**Category:** 🤗 Course Projects\
**Created:** [November 9, 2021, 7:30pm UTC](https://discuss.huggingface.co/t/create-a-pop-music-transformer/11526 "2021-11-09T19:30:09Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![lewtun](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lewtun/32/30995_2.png) [@lewtun](https://discuss.huggingface.co/u/lewtun)\
**Post date:** [November 9, 2021, 7:30pm UTC](https://discuss.huggingface.co/t/create-a-pop-music-transformer/11526/1 "2021-11-09T19:30:09Z")

</div>

> 👋 Please read the topic category [description](https://discuss.huggingface.co/t/about-the-course-projects-category/11510) to understand what this is all about

### Description

If you treat music notation as a form of “text”, you can use language modelling to generate new songs! The goal of this project is to explore how well Transformers perform at music modelling.

### Model(s)

None that we could find on the Hub, but see [here](https://github.com/bearpelican/musicautobot#pretrained-models) for some pretrained music Transformers

### Datasets

None that we could find on the Hugging Face Hub, but see [here](https://github.com/bearpelican/musicautobot#data) for some ideas

### Challenges

This task probably involves pretraining a Transformer, which can potentially take multiple days using the GPU resources provided by AWS. An interesting alternative would be to see whether one can integrate an existing pretrained model within 🤗 Transformers and use that to either fine-tune.

### Desired project outcomes

- Create a Streamlit or Gradio app on [🤗 Spaces](https://huggingface.co/spaces) that people can remix famous songs with newly generated ones
- Don’t forget to push all your models and datasets to the Hub so others can build on them!

### Additional resources

- [https://towardsdatascience.com/creating-a-pop-music-generator-with-the-transformer-5867511b382a](https://towardsdatascience.com/creating-a-pop-music-generator-with-the-transformer-5867511b382a)
- [https://arxiv.org/abs/2002.00212](https://arxiv.org/abs/2002.00212)
- [https://openai.com/blog/jukebox/](https://openai.com/blog/jukebox/)
- [https://research.google/teams/brain/magenta/](https://research.google/teams/brain/magenta/)

### Discord channel

To chat and organise with other people interested in this project, head over to our [Discord](http://xwo7x.mjt.lu/lnk/CAAAAkdkZwAAAAAAAAAAALG-MTEAAYCr4H8AAAAAAAyFyQBhjpnimM4rcE5DT5ibCUtRT96tWwAMh8Y/15/U6BYNMNDksyyGG4jgtzPKQ/aHR0cHM6Ly9odWdnaW5nZmFjZS5jby9qb2luL2Rpc2NvcmQ) and:

- Follow the instructions on the `#join-course` channel

- Join the `#pop-music-transformer` channel

Just make sure you comment here to indicate that you’ll be contributing to this project 🙂

---

<div class="post-metadata">

**Author:** ![psistolar](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/psistolar/32/3150_2.png) [@psistolar](https://discuss.huggingface.co/u/psistolar)\
**Post date:** [November 16, 2021, 10:58pm UTC](https://discuss.huggingface.co/t/create-a-pop-music-transformer/11526/2 "2021-11-16T22:58:28Z")

</div>

This one seems pretty difficult, but too interesting to pass up. I’ll try working on it.

---

<div class="post-metadata">

**Author:** ![lewtun](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lewtun/32/30995_2.png) [@lewtun](https://discuss.huggingface.co/u/lewtun)\
**Post date:** [November 17, 2021, 11:31am UTC](https://discuss.huggingface.co/t/create-a-pop-music-transformer/11526/3 "2021-11-17T11:31:03Z")

</div>

Hey @psistolar ! Yes this is a somewhat challenging project and one that might not be possible in the timeframe if you adopt the pretraining approach. Let me think about how we can simplify it and I’ll post back here 🙂

In the meantime, there’s a new Discord channel (see topic description) in case you and others need it