Pinned Repositories
awesome-japanese-llm
日本語LLMまとめ - Overview of Japanese LLMs
llm-jp-corpus
llm-jp-dpo
llm-jp-eval
llm-jp-model-playground
Interactive application to verify multiple LLMs
llm-jp-sft
llm-jp-tokenizer
llm-jp-VILA
modelwg
LLM-jp Model-WG Working Directory
text2dataset
Easily turn large English text datasets into Japanese text datasets using open LLMs.
llm-jp's Repositories
llm-jp/awesome-japanese-llm
日本語LLMまとめ - Overview of Japanese LLMs
llm-jp/llm-jp-eval
llm-jp/llm-jp-sft
llm-jp/llm-jp-tokenizer
llm-jp/text2dataset
Easily turn large English text datasets into Japanese text datasets using open LLMs.
llm-jp/llm-jp-VILA
llm-jp/Megatron-LM
llm-jp/modelwg
LLM-jp Model-WG Working Directory
llm-jp/nii-sakura-cluster-configs
llm-jp/moe-recipes
llm-jp/scripts
llm-jp/llm-leaderboard
Project of llm evaluation to Japanese tasks
llm-jp/nii-geniac-hpc-toolkit
llm-jp/tuning-competition-baseline
llm-jp/experiments
Issue-Only Pretrain Task Management Repository
llm-jp/tuning-competition
llm-jp/DeepSpeed-MII
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
llm-jp/FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
llm-jp/FastChat2
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
llm-jp/llm-human-eval-jp
llm-jp/llm-jp-membership-inference
This is the repository for llm jp membership inference attack.
llm-jp/llmjp_topic_model
llm-jp/lm-evaluation-harness
A framework for few-shot evaluation of language models.
llm-jp/nii-geniac-gcp-lustre
GENIAC用のLustreクラスタ構築スクリプト
llm-jp/nlp2025-ws
NLP2025ワークショップ「大規模言語モデルのファインチューニング技術と評価」
llm-jp/swallow-evaluation-vllm
llm-jp/Toxicity_Filter
A DeBERTa-based toxicity filter trained on LLM-jp Toxicity Dataset
llm-jp/Toxicity_Filter_fastText
A fastText-based classifier for removing toxic texts from corpora, trained on automatically generated labeled data.
llm-jp/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
llm-jp/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs