atilika/kuromoji

Issues

• Kuromoji_tokenizer: sort clause does not seem to work for some specific character combinations

  #141 opened 9 months ago by ajaypvymo
  0

• Kanji penalty and other penalty

  #140 opened a year ago by elialm7
  0

• Handling of userDictionary comments

  #139 opened 2 years ago by tottokug
  0

• 日本人 is not divided into two sections even in extended mode

  #138 opened 3 years ago by hohno-panopto
  0

• ソーシャルメディア is not tokenized into two words

  #137 opened 3 years ago by hohno-panopto
  0

• Question: Is there any way to update neologd dictionary?

  #135 opened 4 years ago by tstsukahara
  0

• How to enable discardPunctuation in Kuromoji Java

  #134 opened 4 years ago by yanghanxy
  0

• how to increase heap size other than MAVEN_OPS

  #133 opened 4 years ago by kazukousen
  0

• Next release?

  #131 opened 5 years ago by mpriala-code
  2

• Configuring with Maven

  #132 opened 5 years ago by Zurdge
  3

• Optimization opportunity in the fst usage.

  #130 opened 5 years ago by fulmicoton
  2

• Kuromoji POS Train

  #129 opened 6 years ago by abhinandansrivastava
  0

• Normalized surface in user dictionary.

  #126 opened 7 years ago by mrikitoku
  5

• Unidic design flaw

  #118 opened 7 years ago by wareya
  4

• Compound word with nakaguro in it

  #104 opened 7 years ago by mhko
  2

• Nexus Repository is Offline?

  #123 opened 7 years ago by ryantenney
  1

• Segmentation wrong with token contains square brackets?

  #108 opened 8 years ago by reckart
  3

• tokenize 一人（ひとり,hitori）will be seperate as 一(いち,ichi) 人（ひと,hito）

  #125 opened 7 years ago by andy840119
  1

• Obtain furigana?

  #121 opened 7 years ago by 0x6C38
  1

• How to use Kuromoji in Gradle?

  #120 opened 7 years ago by weituotian
  4

• Kuromoji on Android

  #96 opened 9 years ago by jendib
  9

• Why does tokenized Kanji features never contains Hiragana ?

  #119 opened 7 years ago by theGlenn
  1

• Internals documentation and academic papers?

  #117 opened 7 years ago by DarrenCook
  1

• Possible Issue with tokenization when English+Japanese are adjacent in text

  #116 opened 8 years ago by bbguitar77
  0

• Longer string in Katakana has low priority

  #115 opened 8 years ago by oharato
  0

• The tokenizing performance of mixed language

  #113 opened 8 years ago by kwkwvenusgod
  0

• Question: how to obtain multiple parsings?

  #99 opened 9 years ago by fasiha
  5

• http://www.atilika.org showcases the outdated maven artifact repository information

  #111 opened 8 years ago by titsuki
  0

• java.lang.RuntimeException: Could not load dictionaries. Caused by: java.io.IOException: Classpath resource not found: fst.bin

  #110 opened 8 years ago by proninalex
  0

• Is there any example for Lemmatization?

  #107 opened 8 years ago by RangerWolf
  0

• Tokenizing text in Hiragana character set

  #105 opened 9 years ago by mhko
  5

• Unidic Tokenization on Romaji Words

  #103 opened 9 years ago by tobias-khs
  0

• Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12.4:test (default-test) on project kuromoji-benchmark: There are test failures.

  #81 opened 9 years ago by kallewoof
  2

• Android runtime exception when creating new Tokenizer using kuromoji-ipadic

  #98 opened 9 years ago by hk0i
  14

• Very odd tokenization of a sentence

  #82 opened 9 years ago by kallewoof
  2

• Tokenizer is not serializable for Apache Spark

  #85 opened 9 years ago by lamrongol
  7

• Integration with solr

  #87 opened 9 years ago by nisha-kajale
  3

• GC overhead limit exceeded when compiling IPADIC NEologd

  #79 opened 9 years ago by kallewoof
  2