hyunwoongko

polyglot

Polyglot: Large Language Models of Well-balanced Competence in Multi-languages

kochat

Opensource Korean chatbot framework

kss

KSS: Korean String processing Suite

nlp-datasets

Curation note of NLP datasets

openchat

OpenChat: Easy to use opensource chatting framework via neural networks

pecab

Pecab: Pure python Korean morpheme analyzer based on Mecab

transformer

Transformer: PyTorch Implementation of "Attention Is All You Need"

pororo

PORORO: Platform Of neuRal mOdels for natuRal language prOcessing

oslo

OSLO: Open Source framework for Large-scale model Optimization

parallelformers

Parallelformers: An Efficient Model Parallelization Toolkit for Deployment

hyunwoongko/transformer

Transformer: PyTorch Implementation of "Attention Is All You Need"

hyunwoongko/kochat

Opensource Korean chatbot framework

hyunwoongko/openchat

OpenChat: Easy to use opensource chatting framework via neural networks

hyunwoongko/kss

KSS: Korean String processing Suite

hyunwoongko/pecab

Pecab: Pure python Korean morpheme analyzer based on Mecab

hyunwoongko/nlp-datasets

Curation note of NLP datasets

hyunwoongko/kocrawl

Collection of useful Korean crawlers

hyunwoongko/python-mecab-kor

Yet another python binding for mecab-ko

hyunwoongko/summarizers

Package for controllable summarization

hyunwoongko/gpt2-tokenizer-java

Java implementation of GPT2 tokenizer.

hyunwoongko/kobart-transformers

Kobart model on Huggingface transformers

hyunwoongko/pydatrie

Pure python implementation of DARTS (Double ARray Trie System)

hyunwoongko/dialobot

Opensource chatbot framework

hyunwoongko/beyond-lm

Beyond LM: How can language model go forward in the future?

hyunwoongko/stop-sequencer

Implementation of stop sequencer for Huggingface Transformers

hyunwoongko/fast_retention

Speed up Parallel Retention about 2x times

hyunwoongko/hyunwoongko

miscellaneous

hyunwoongko/mamba

hyunwoongko/code-pipeline

Test repository for AWS code-pipeline deployment.

hyunwoongko/Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

hyunwoongko/Open-Assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

hyunwoongko/OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (Support 70B+ full tuning & LoRA & Mixtral & KTO)

hyunwoongko/python-nori

Pynori - Lucene Nori, Korean Mopological Analyzer, in Python

hyunwoongko/stripedhyena

hyunwoongko/DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

hyunwoongko/kiwipiepy

Python API for Kiwi

hyunwoongko/ooo-backprop

hyunwoongko/simpleDATrie

Simple Double Array Trie implementation

hyunwoongko/text-generation-inference

Large Language Model Text Generation Inference

hyunwoongko/trl

Train transformer language models with reinforcement learning.