pre-trained-model
There are 203 repositories under pre-trained-model topic.
microsoft/unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
thunlp/OpenPrompt
An Open-Source Framework for Prompt-Learning.
brightmart/albert_zh
A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型
ChineseGLUE/ChineseGLUE
Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard
ymcui/Chinese-ELECTRA
Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）
keyu-tian/SparK
[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"
zjunlp/KnowLM
An Open-sourced Knowledgable Large Language Model Framework.
d-li14/involution
[CVPR 2021] Involution: Inverting the Inherence of Convolution for Visual Recognition, a brand new neural operator
zjunlp/KnowledgeEditingPapers
Must-read Papers on Knowledge Editing for Large Language Models.
deepmodeling/Uni-Mol
Official Repository for the Uni-Mol Series Methods
NVlabs/FasterViT
[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention
MrGiovanni/ModelsGenesis
[MICCAI 2019 Young Scientist Award] [MEDIA 2020 Best Paper Award] Models Genesis
salesforce/PCL
PyTorch code for "Prototypical Contrastive Learning of Unsupervised Representations"
mims-harvard/TFC-pretraining
Self-supervised contrastive learning for time series via time-frequency consistency
edenai/edenai-apis
Eden AI: simplify the use and deployment of AI technologies by providing a unique API that connects to the best possible AI engines
NVlabs/GCVit
[ICML 2023] Official PyTorch implementation of Global Context Vision Transformers
HKUDS/UrbanGPT
[KDD'2024] "UrbanGPT: Spatio-Temporal Large Language Models"
MrGiovanni/SuPreM
[ICLR 2024 Oral] Supervised Pre-Trained 3D Models for Medical Image Analysis (9,262 CT volumes + 25 annotated classes)
ymcui/PERT
PERT: Pre-training BERT with Permuted Language Model
nogibjj/rust-mlops-template
A work in progress to build out solutions in Rust for MLOPs
iflytek/MiniRBT
MiniRBT (中文小型预训练模型系列)
hjbahng/visual_prompting
Exploring Visual Prompts for Adapting Large-Scale Models
ZhangYuanhan-AI/NOAH
[TPAMI] Searching prompt modules for parameter-efficient transfer learning.
rsommerfeld/trocr
Powerful handwritten text recognition. A simple-to-use, unofficial implementation of the paper "TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models".
YuanchenBei/Awesome-Pretraining-for-Graph-Neural-Networks
A curated list of papers on pre-training for graph neural networks (Pre-train4GNN).
balavenkatesh3322/audio-pretrained-model
A collection of Audio and Speech pre-trained models.
YicongHong/Recurrent-VLN-BERT
Code of the CVPR 2021 Oral paper: A Recurrent Vision-and-Language BERT for Navigation
zjunlp/MolGen
[ICLR 2024] Domain-Agnostic Molecular Generation with Chemical Feedback
helicalAI/helical
A framework for state-of-the-art pre-trained bio foundation models on genomics and transcriptomics modalities.
HKUDS/HiGPT
[KDD'2024] "HiGPT: Heterogenous Graph Language Models"
siat-nlp/GALAXY
Official repository of the AAAI'2022 paper "GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injection"
lyy1994/awesome-data-contamination
The Paper List on Data Contamination for Large Language Models Evaluation.
HKUDS/GPT-ST
[NeurIPS'2023] "GPT-ST: Generative Pre-Training of Spatio-Temporal Graph Neural Networks"
RL4M/MRM-pytorch
An official implementation of Advancing Radiograph Representation Learning with Masked Record Modeling (ICLR'23)
masoudnick/Brain-Tumor-MRI-Classification
Brain Tomur Classification Using Pre-trained Models
RUCAIBox/MVP
This repository is the official implementation of our paper MVP: Multi-task Supervised Pre-training for Natural Language Generation.