KoichiYasuoka

KoichiYasuoka's Stars

• chakki-works/sumeval

  Well tested & Multi-language evaluation framework for text summarization.

  Language:Python618181858

• polm/fugashi

  A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.

  Language:C++42687736

• ikegami-yukino/mecab

  Notice: This repository will be archived... This repository is for building Windows 64-bit MeCab binary and improving MeCab Python binding.

  Language:C++25111516

• explosion/tokenizations

  Robust and Fast tokenizations alignment library for Rust and Python https://tamuhey.github.io/tokenizations/

  Language:Rust190101120

• taishi-i/toiro

  A comparison tool of Japanese tokenizers

  Language:Python120729

• shenshen-hungry/Ancient-Chinese-Segmentation

  A tool for ancient Chinese segmentation.

  53717

• retarfi/language-pretraining

  Pre-training Language Models for Japanese

  Language:Python49445

• akirakubo/bert-japanese-aozora

  Japanese BERT trained on Aozora Bunko and Wikipedia, pre-tokenized by MeCab with UniDic & SudachiPy

  40323

• clarinsi/classla

  CLASSLA Fork of the Official Stanford NLP Python Library for Many Human Languages

  Language:Python4054419

• amir-zeldes/HebPipe

  An NLP pipeline for Hebrew

  Language:Lex3622010

• informatix-inc/bert

  Language:Python28012

• megagonlabs/UD_Japanese-GSD

  Japanese data from the Google UDT 2.0.

  Language:Python28102

• megagonlabs/ginza-transformers

  Use custom tokenizers in spacy-transformers

  Language:Python16535

• ipipan/combo

  Dependency Parsing library

  Language:Python9311

• gossebouma/lassy2ud

  Lassy Small to Universal Dependencies Conversion

  Language:XQuery6331

• UniversalDependencies/UD_Japanese-GSDLUW

  Long-unit-word version of UD_Japanese-GSD

  314211

• UniversalDependencies/UD_Tatar-NMCTT

  21430