facebookresearch/MobileLLM

Plans to release the model checkpoints on Hugging Face Hub?

Vaibhavs10 opened this issue · 11 comments

Vaibhavs10 commented

Hey hey! Congratulations on the brilliant release. I'm VB, and I'm working on the open-source team at Hugging Face.

I was wondering if you already plan to release the model checkpoints trained as part of the paper. The community can learn a lot from these checkpoints, evaluate, test, and even fine-tune them for specific tasks!

Happy to help with the model checkpoints release and the hub stuff if it helps.

Thanks again for releasing the codebase; I'm hoping y'all release the checkpoints, too.

Cheers,
VB

liuzechun commented

Hi VB,

Thanks for reaching out!

Yes, that's in our plan. We are working with the legal team to make the models publicly available. It is taking longer than we expected. We'll update you here once it is approved by the legal team.

Thanks,
Zechun

  • ❤️5
Vaibhavs10 commented

Hi @liuzechun, That's brilliant! I'm looking forward to the checkpoints; there's a lot of community excitement about them!

Some quick doc links to help you when the legal approves them:

  1. Our recommendation is to have one model checkpoint per repository. You can find all the details related to upload here in this guide: https://huggingface.co/docs/hub/models-uploading
  2. You can use Collections to group and share all the model checkpoints together: https://huggingface.co/docs/hub/en/collections
  3. In addition to this you can also add MobileLLM as a library on the hub so that all the models trained from it can be neatly organised: https://huggingface.co/docs/hub/en/models-adding-libraries#register-your-libraries-supported-tasks-on-the-hub

Let me know if you need any help with this! I'm at vaibhav [at] hf [dot] co or just DM me on Twitter (reach_vb)

  • ❤️5
ahmadmustafaanis commented

waiting for it

  • 👍3
  • 👀3
redagavin commented

Is there any progress?

chenzx2 commented

waiting for it

ftgreat commented

waiting for it

Vaibhavs10 commented

Hey @liuzechun - Wondering if there's any update on the model weights? Do let me know if I/ Hugging Face can help out in anyway. 🤗

  • ❤️1
liuzechun commented

Hi @Vaibhavs10! Thanks for following up! @ahmadmustafaanis @redagavin @chenzx2 Thanks for your interest.
🌟The MobileLLM weights are now available on Hugging Face! 🚀
✨https://huggingface.co/collections/facebook/mobilellm-6722be18cb86c20ebe113e95

  • ❤️5
  • 🚀1
Vaibhavs10 commented

Thanks a ton for the release @liuzechun 🔥 - this is brilliant!

  • ❤️1
Vaibhavs10 commented

Hey @liuzechun - I opened some quick PRs on the model repos to improve metadata, this will also automatically add code snippets to the model repos too:

https://huggingface.co/facebook/MobileLLM-125M/discussions/1
https://huggingface.co/facebook/MobileLLM-350M/discussions/2
https://huggingface.co/facebook/MobileLLM-600M/discussions/1
https://huggingface.co/facebook/MobileLLM-1B/discussions/1

Let me know if you have any questions! 🤗

  • ❤️1
liuzechun commented

Thank you @Vaibhavs10, just merged your pull requests!

  • ❤️1