JavaScript Lemmatizer

JavaScript Lemmatizer is a lemmatization library for JavaScript to retrieve a base form from an inflected form word in English.

Inspired by Ruby Lemmatizer but the returned values and the algorithm are different from it.

Requirements

Depends on Underscore.js.

Underscore.js

Demo

A sample html is bundled in this library. The sample html code and the demo page are followings.

The sample html code depends on jQuery.

jQuery

Check

The operation check is conducted in the following web browsers with Mac OS X.

Firefox 35.0
Google Chrome 40.0
Safari 6.1.6
Opera 25.0

Install

1. Download and unzip JavaScript Lemmatizer, and then put it in your project.

Directories of dict, js in JavaScript Lemmatizer are must, so you can put it in your project like this.

your-project
├ index.html
├ javascript-lemmatizer
    ├ dict
    ├ js
    ├ bower_components
        ├ jquery
        ├ underscore

2. Load Underscore.js and JavaScript Lemmatizer in your HTML like the following code.

<script src="javascript-lemmatizer/bower_components/underscore/underscore.js"></script>
<script src="javascript-lemmatizer/js/lemmatizer.js"></script>

Or you can load Underscore.js the way you like.

As an option, you can load jQuery, if you need it in your project.

<script src="javascript-lemmatizer/bower_components/jquery/dist/jquery.js"></script>
<script src="javascript-lemmatizer/bower_components/underscore/underscore.js"></script>
<script src="javascript-lemmatizer/js/lemmatizer.js"></script>

3. Use JavaScript Lemmatizer in your JavaScript code according to the Usage.

Usage

You can use Lemmatizer#lemmas or Lemmatizer#only_lemmas methods like the follwoing sample in your JavaScript code.

// initialize Lemmatizer.
var lemmatizer = new Lemmatizer();

// retrieve a lemma with a part of speech.
// you can assign 'verb' or 'noun' or 'adj' or 'adv' as a part of speech.
lemmatizer.lemmas('desks',  'noun');   // => [ ['desk', 'noun'] ]
lemmatizer.lemmas('talked', 'verb');   // => [ ['talk', 'verb'] ]
lemmatizer.lemmas('coded', 'verb');    // => [ ['code', 'verb'] ]

// of course, available for irregular iflected form words.
lemmatizer.lemmas('went', 'verb');     // => [ ['go', 'verb'] ]
lemmatizer.lemmas('written', 'verb');  // => [ ['write', 'verb'] ]
lemmatizer.lemmas('better', 'adj');    // => [ ['better', 'adj'], ['good', 'adj'] ]

// when multiple base forms are found, return all of them.
lemmatizer.lemmas('leaves', 'noun');   // => [ ['leave', 'noun'], ['leaf', 'noun'] ]

// retrieve a lemma without a part of speech.
lemmatizer.lemmas('sitting');  // => [ ['sit', 'verb'], ['sitting', 'noun'], ['sitting', 'adj'] ]
lemmatizer.lemmas('oxen');     // => [ ['oxen', 'noun'], ['ox', 'noun'] ]
lemmatizer.lemmas('leaves');   // => [ ['leave', 'verb'], ['leave', 'noun'], ['leaf', 'noun'] ]

// retrieve only lemmas not including part of speeches in the returned value.
lemmatizer.only_lemmas('desks', 'noun');  // => [ 'desk' ]
lemmatizer.only_lemmas('coded', 'verb');  // => [ 'code' ]
lemmatizer.only_lemmas('priorities');     // => [ 'priority' ]
lemmatizer.only_lemmas('leaves');         // => [ 'leave', 'leaf' ]

Limitations

// Lemmatizer leaves alone a word not included in it's dictionary index.
lemmatizer.lemmas('MacBooks', 'noun');  // => [ ['MacBooks', 'noun'] ]

Changelog

v0.0.2

2015/01/30 With v0.0.2, a returned value includes the input form word, when the input form word is included in the lemma dictionary index like the following.

lemmatizer.lemmas('matter');  // => [ ['matter', 'verb'], ['matter', 'noun'], ['matte', 'adj'], ['matt', 'adj'], ['mat', 'adj'] ]

With v0.0.1

lemmatizer.lemmas('matter');  // => [ ['matte', 'adj'], ['matt', 'adj'], ['mat', 'adj'] ]

v0.0.1

2015/01/27 Released JavaScript Lemmatizer v0.0.1

Contribution

Fork it ( https://github.com/takafumir/javascript-lemmatizer/fork )
Create your feature branch (git checkout -b my-new-feature)
Commit your changes (git commit -am 'Add some feature')
Push to the branch (git push origin my-new-feature)
Create a new Pull Request

Licence

MIT License

Author

Takafumi Yamano

takafumir/javascript-lemmatizer