chinese-word-segmentation
There are 95 repositories under chinese-word-segmentation topic.
Embedding/Chinese-Word-Vectors
100+ Chinese Word Vectors 上百种预训练中文词向量
lancopku/pkuseg-python
pkuseg多领域中文分词工具; The pkuseg toolkit for multi-domain Chinese word segmentation
baidu/lac
百度NLP:分词,词性标注,命名实体识别,词重要性
ownthink/Jiagu
Jiagu深度学习自然语言处理工具 知识图谱关系抽取 中文分词 词性标注 命名实体识别 情感分析 新词发现 关键词 文本摘要 文本聚类
hankcs/pyhanlp
中文分词
wolfgarbe/SymSpell
SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm
didi/ChineseNLP
Datasets, SOTA results of every fields of Chinese NLP
lionsoul2014/jcseg
Jcseg is a light weight NLP framework developed with Java. Provide CJK and English segmentation based on MMSEG algorithm, With also keywords extraction, key sentence extraction, summary extraction implemented based on TEXTRANK algorithm. Jcseg had a build-in http server and search modules for lucene,solr,elasticsearch,opensearch
mammothb/symspellpy
Python port of SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm
messense/jieba-rs
The Jieba Chinese Word Segmentation Implemented in Rust
lionsoul2014/friso
High performance Chinese tokenizer with both GBK and UTF-8 charset support based on MMSEG algorithm developed by ANSI C. Completely based on modular implementation and can be easily embedded in other programs, like: MySQL, PostgreSQL, PHP, etc.
monpa-team/monpa
MONPA 罔拍是一個提供正體中文斷詞、詞性標註以及命名實體辨識的多任務模型
Kyubyong/g2pC
g2pC: A Context-aware Grapheme-to-Phoneme Conversion module for Chinese
hemingkx/WordSeg
A PyTorch implementation of a BiLSTM \ BERT \ Roberta (+ BiLSTM + CRF) model for Chinese Word Segmentation (中文分词) .
supercoderhawk/DeepLearning_NLP
基于深度学习的自然语言处理库
howl-anderson/MicroTokenizer
一个微型&算法全面的中文分词引擎 | A micro tokenizer for Chinese
llhthinker/MachineLearningLab
Some experiments about Machine Learning
xtea/chinese_medical_words
手工整理医疗行业词汇、术语等语料。可用于语音识别、对话系统等各类nlp模型训练。
fudannlp16/CWS_Dict
Source codes for paper "Neural Networks Incorporating Dictionaries for Chinese Word Segmentation", AAAI 2018
jcyk/greedyCWS
Source code for an ACL2017 paper on Chinese word segmentation
yizhiru/thulac4j
Chinese Word Segmentation Tool, THULAC的Java实现.
NLPIR-team/nlpir-analysis-cn-ictclas
Lucene/Solr Analyzer Plugin. Support MacOS,Linux x86/64,Windows x86/64. It's a maven project, which allows you change the lucene/solr version. //Maven工程,修改Lucene/Solr版本,以兼容相应版本。
supercoderhawk/DNN_CWS
利用深度学习实现中文分词
voidism/pywordseg
Open Source State-of-the-art Chinese Word Segmentation System with BiLSTM and ELMo. https://arxiv.org/abs/1901.05816
dongrixinyu/jiojio
A convenient Chinese word segmentation tool 简便中文分词器
supercoderhawk/DeepNLP
基于深度学习的自然语言处理库
wchan757/Cantonese_Word_Segmentation
Dictionary for Cantonese word segmentation
hankcs/sub-character-cws
Sub-Character Representation Learning
binaryoung/jieba-php
The Jieba Chinese Word Segmentation Implemented in PHP
bububa/jiagu
Jiagu深度学习自然语言处理工具 知识图谱关系抽取 中文分词 词性标注 命名实体识别 情感分析 新词发现 关键词 文本摘要 文本聚类
Hoiy/berserker
Berserker - BERt chineSE woRd toKenizER
NLPIR-team/NLPIR-ICTCLAS
The Java Package of NLPIR-ICTCLAS.
wangjksjtu/multi-embedding-cws
Multiple Character Embeddings for Chinese Word Segmentation, ACL 2019
messense/cjieba-py
Python cffi binding to CppJieba
fg607/ChatterBot
ChatterBot中文适配版,支持中文分词搜索和中文停用词
GanjinZero/GTS
Code for Unsupervised multi-granular Chinese word segmentation and term discovery via graph partition [JBI]