meilisearch/charabia

Issues

• charabia can't be built in Windows due to jemallocator used only for bench

  #314 opened a month ago by tats-u
  1

• `into_tokenizer` don't work with stop_words

  #319 opened a month ago by ManyTheFish
  0

• latin-camelcase feature make wrong segmentation

  #289 opened 2 months ago by hamano
  11

• Normalization Issue for Turkish Characters in Charabia

  #316 opened 2 months ago by niyazialpay
  3

• Normalization Issue for Turkish Characters in Charabia

  #294 opened 4 months ago by niyazialpay
  7

• Update wana_kana to 4.0.0

  #313 opened 2 months ago by tats-u
  0

• Numbers are not segmented the same way depending on the Script/Language

  #271 opened 2 months ago by ManyTheFish
  13

• Persian language support for normalization and segmentation

  #304 opened 5 months ago by Ja7ad
  6

• Add Math symbols in the default separator list

  #300 opened 5 months ago by ManyTheFish
  0

• The `chinese-normalization-pinyin` feature flag doesn't compile

  #290 opened 7 months ago by ManyTheFish
  6

• Normalize "œ" / "æ" into "oe" / "ae"

  #268 opened 7 months ago by ManyTheFish
  0

• Rework Chinese Pinyin normalizer

  #285 opened 8 months ago by ManyTheFish
  0

• Cross-compiling charabia for arm

  #265 opened a year ago by chiru-arh
  5

• Tokenization of japan text with disabled default features

  #229 opened a year ago by generall
  3

• Tag and release new version?

  #276 opened 9 months ago by 6543
  1

• [Maintainance] Review and amend documentation in files

  #272 opened 10 months ago by ManyTheFish
  0

• Ð vs Đ differentiate

  #245 opened a year ago by ngdbao
  7

• Latin script: segmenter should support word segmentation

  #175 opened 2 years ago by Kerollmops
  7

• Compilation warnings when not using default features

  #260 opened a year ago by timvisee
  0

• Compiler failure without vietnamese feature

  #258 opened a year ago by timvisee
  0

• Fix kvariant CI

  #254 opened a year ago by ManyTheFish
  0

• remove unnecessary iteration in khmer segmenter

  #250 opened a year ago by xshadowlegendx
  2

• Add Khmer support information to README

  #246 opened a year ago by curquiza
  0

• add support for khmer language

  #200 opened a year ago by xshadowlegendx
  0

• Test this library against invalid and strange input

  #235 opened a year ago by Kerollmops
  0

• Implement the `CharNormalizer` trait on the `LowercaseNormalizer` struct

  #239 opened a year ago by Kerollmops
  0

• Chinese segmentation not correct

  #226 opened a year ago by sivdead
  2

• Upgrade dependencies

  #151 opened 2 years ago by curquiza
  7

• Implement Vietnamese tokenizer for Meilisearch

  #174 opened 2 years ago by kimyvgy
  2

• Publish hfhchan kvariants wrapper on crates.io

  #184 opened 2 years ago by ManyTheFish
  3

• Arabic script: Implement specialized Segmenter

  #133 opened 2 years ago by ManyTheFish
  9

• Fix compilation without `greek` feature enabled

  #201 opened 2 years ago by akeamc
  0

• Create a CI keeping kvariants up-to-date

  #185 opened 2 years ago by ManyTheFish
  2

• Latin script: Segmenter should split camelCased words

  #129 opened 2 years ago by ManyTheFish
  8

• Arabic script: Add an Normalizer removing Tatweel

  #186 opened 2 years ago by ManyTheFish
  0

• Greek script: Normalize Sigma

  #179 opened 2 years ago by ManyTheFish
  0

• Greek Script: Normalize accents

  #178 opened 2 years ago by ManyTheFish
  0

• clippy CI fail with latest toolchain

  #176 opened 2 years ago by choznerol
  0

• Classify tokens after Segmentation instead of Normalization

  #150 opened 2 years ago by ManyTheFish
  0

• Implement a Compatibility Decomposition Normalizer

  #139 opened 2 years ago by ManyTheFish
  5

• Enhance Chinese normalizer by unifying `Z`, `Simplified`, and `Semantic` variants

  #144 opened 2 years ago by ManyTheFish
  2

• Refactor normalizers

  #156 opened 2 years ago by ManyTheFish
  0

• Implement a Japanese specialized Normalizer

  #131 opened 2 years ago by ManyTheFish
  8

• Korean support

  #153 opened 2 years ago by qbx2
  0

• Add an allowlist to the tokenizer builder

  #132 opened 2 years ago by ManyTheFish
  2

• Move the FST based Segmenter in a standalone file

  #130 opened 2 years ago by ManyTheFish
  0

• Implement an efficient `Nonspacing Mark` Normalizer

  #137 opened 2 years ago by ManyTheFish
  2

• Implement Jyutping normalizer

  #134 opened 2 years ago by ManyTheFish
  1

• Implement Pinyin normalizer

  #135 opened 2 years ago by ManyTheFish
  0

• Upgrade Whatlang dependency

  #141 opened 2 years ago by ManyTheFish
  2