/IMelodist

Music large model based on InternLM2-chat.

Primary LanguagePython

Melodist ABC-notation music model based on InternLM2-chat.

Music is a higher revelation than all wisdom and philosophy. — Ludwig van Beethoven

📖Technical Report | 🌐Video Demo | 🎼IMelodist-app

Open in OpenXLab HF Model HF Dataset Increment HF Dataset SFT

《旋律大师-IMelodist》项目获上海人工智能实验室主办的2024浦源大模型系列挑战赛春季赛创新创意奖!!!

image

📝 目录

🥰 快速体验

已部署在openXLab上啦,若应用休眠,请点击重新启动后耐心等待。 image

🤖 模型架构

本地运行

安装依赖

# 此处我们使用的环境是 Ubuntu 20.04, 其他系统自行寻找相应的库安装
sudo xargs -r -a packages.txt apt-get install -y
pip install -r requirements.txt

下载模型

提供了两种下载方式:

  • 从 OpenXLab 上下载
git lfs install
git clone https://code.openxlab.org.cn/EchoPeter/IMelodist.git

或者

参考 下载模型

pip install openxlab
from openxlab.model import download
download(model_repo='EchoPeter/IMelodist', 
        model_name='IMelodist', output='./')
pip install modelscope
from modelscope.hub.snapshot_download import snapshot_download
model_dir = snapshot_download('PommesPeter/IMelodist-chat-7b', cache_dir='./')

运行 Web Demo

IMelodist_demo.py 文件中第42行的 model_path 改成本地 IMelodist 模型所在路径后,运行以下指令。

# 确保terminal所在位置为repo主目录
streamlit run chat/IMelodist_demo.py --server.address=0.0.0.0 --server.port 7860

📄 项目相关资源和消息

  • [2024/3] 2024浦源大模型系列挑战赛(春季赛)|创新创意奖 GDC2024
  • [2024/3] 推送分享 InternLM,机智流
  • [2024/3/17] 书生·浦语 训练营 SIG小组 圆桌分享 [视频, slide]

❤️ 致谢

贡献者

星矢😆

Star History Chart

BibTeX entry and citation info

@inproceedings{DBLP:conf/hcmir/WuLY023,
  author       = {Shangda Wu and
                  Xiaobing Li and
                  Feng Yu and
                  Maosong Sun},
  editor       = {Lorenzo Porcaro and
                  Roser Batlle{-}Roca and
                  Emilia G{\'{o}}mez},
  title        = {TunesFormer: Forming Irish Tunes with Control Codes by Bar Patching},
  booktitle    = {Proceedings of the 2nd Workshop on Human-Centric Music Information
                  Retrieval 2023 co-located with the 24th International Society for
                  Music Information Retrieval Conference {(ISMIR} 2023), Milan, Italy,
                  November 10, 2023},
  series       = {{CEUR} Workshop Proceedings},
  volume       = {3528},
  publisher    = {CEUR-WS.org},
  year         = {2023},
  url          = {https://ceur-ws.org/Vol-3528/paper1.pdf},
  timestamp    = {Tue, 19 Dec 2023 17:15:12 +0100},
  biburl       = {https://dblp.org/rec/conf/hcmir/WuLY023.bib},
  bibsource    = {dblp computer science bibliography, https://dblp.org}
}
@misc{yuan2024chatmusician,
      title={ChatMusician: Understanding and Generating Music Intrinsically with LLM}, 
      author={Ruibin Yuan and Hanfeng Lin and Yi Wang and Zeyue Tian and Shangda Wu and Tianhao Shen and Ge Zhang and Yuhang Wu and Cong Liu and Ziya Zhou and Ziyang Ma and Liumeng Xue and Ziyu Wang and Qin Liu and Tianyu Zheng and Yizhi Li and Yinghao Ma and Yiming Liang and Xiaowei Chi and Ruibo Liu and Zili Wang and Pengfei Li and Jingcheng Wu and Chenghua Lin and Qifeng Liu and Tao Jiang and Wenhao Huang and Wenhu Chen and Emmanouil Benetos and Jie Fu and Gus Xia and Roger Dannenberg and Wei Xue and Shiyin Kang and Yike Guo},
      year={2024},
      eprint={2402.16153},
      archivePrefix={arXiv},
      primaryClass={cs.SD}
@misc{2024imelodist,
      title={IMelodist: Music Large Language Model from Internlm2-7B finetuning}, 
      author={IMelodist Contributor},
      year={2024},
      url={https://github.com/GuoYiFantastic/IMelodist}
}

🧾 开源许可证

该项目采用 Apache License 2.0 开源许可证 同时,请遵守所使用的模型与数据集的许可证。