megatron

There are 9 repositories under megatron topic.

  • modelscope/ms-swift

    Use PEFT or Full-parameter to finetune 350+ LLMs or 90+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-Vision, Llava, InternVL2, MiniCPM-V-2.6, GLM4v, Xcomposer2.5, Yi-VL, DeepSeek-VL, Phi3.5-Vision, ...)

    Language:Python3.7k201.1k313

  • eyaadh/megadlbot_oss

    Megatron was a telegram file management bot that helped a lot of users, specially movie channel managers to upload their files to telegram by just providing a link to it. The project initially started as roanuedhuru_bot which lately retired and came back as Megatron which was a side project of the famous Maldivian Telegram community - @Baivaru until it retired.

    Language:Python1781013164

  • xrsrke/pipegoose

    Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*

    Language:Python7743217

  • MoFHeka/LLaMA-Megatron

    A LLaMA1/LLaMA12 Megatron implement.

    Language:Python26172

  • liangyuwang/Tiny-Megatron

    Tiny-Megatron, a minimalistic re-implementation of the Megatron library

    Language:Python320

  • Sh-Jil/megadlbot

    Megatron was a telegram file management bot that helped a lot of users, specially movie channel managers to upload their files to telegram by just providing a link to it. The project initially started as roanuedhuru_bot which lately retired and came back as Megatron which was a side project of the famous Maldivian Telegram community -

    Language:Python3106

  • future-wd/course-hugo-bootstrap-introduction

    A course which takes you through the entire process of setting up a Hugo project with Bootstrap. It also teaches you the basics of bootstrap to get you up and running.

    Language:HTML1004

  • Dikhudu/megaTRON

    Java implementation of the Tron whitepaper

    Language:Java0000

  • mihirkudale/Megatron-NLP-Project

    Language:JavaScript10