Pinned Repositories
polyglot
Polyglot: Large Language Models of Well-balanced Competence in Multi-languages
kochat
Opensource Korean chatbot framework
kss
KSS: Korean String processing Suite
nlp-datasets
Curation note of NLP datasets
openchat
OpenChat: Easy to use opensource chatting framework via neural networks
pecab
Pecab: Pure python Korean morpheme analyzer based on Mecab
transformer
Transformer: PyTorch Implementation of "Attention Is All You Need"
kanana
Kanana: Compute-efficient Bilingual Language Models
pororo
PORORO: Platform Of neuRal mOdels for natuRal language prOcessing
parallelformers
Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
hyunwoongko's Repositories
hyunwoongko/transformer
Transformer: PyTorch Implementation of "Attention Is All You Need"
hyunwoongko/kochat
Opensource Korean chatbot framework
hyunwoongko/kss
KSS: Korean String processing Suite
hyunwoongko/openchat
OpenChat: Easy to use opensource chatting framework via neural networks
hyunwoongko/pecab
Pecab: Pure python Korean morpheme analyzer based on Mecab
hyunwoongko/nlp-datasets
Curation note of NLP datasets
hyunwoongko/kocrawl
Collection of useful Korean crawlers
hyunwoongko/python-mecab-kor
Yet another python binding for mecab-ko
hyunwoongko/summarizers
Package for controllable summarization
hyunwoongko/gpt2-tokenizer-java
Java implementation of GPT2 tokenizer.
hyunwoongko/kobart-transformers
Kobart model on Huggingface transformers
hyunwoongko/pydatrie
Pure python implementation of DARTS (Double ARray Trie System)
hyunwoongko/stop-sequencer
Implementation of stop sequencer for Huggingface Transformers
hyunwoongko/beyond-lm
Beyond LM: How can language model go forward in the future?
hyunwoongko/fast_retention
Speed up Parallel Retention about 2x times
hyunwoongko/hyunwoongko
miscellaneous
hyunwoongko/mamba
hyunwoongko/mygrad
hyunwoongko/code-pipeline
Test repository for AWS code-pipeline deployment.
hyunwoongko/Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
hyunwoongko/Open-Assistant
OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
hyunwoongko/OpenRLHF
An Easy-to-use, Scalable and High-performance RLHF Framework (Support 70B+ full tuning & LoRA & Mixtral & KTO)
hyunwoongko/python-nori
Pynori - Lucene Nori, Korean Mopological Analyzer, in Python
hyunwoongko/stripedhyena
hyunwoongko/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
hyunwoongko/kiwipiepy
Python API for Kiwi
hyunwoongko/ooo-backprop
hyunwoongko/simpleDATrie
Simple Double Array Trie implementation
hyunwoongko/text-generation-inference
Large Language Model Text Generation Inference
hyunwoongko/trl
Train transformer language models with reinforcement learning.