snipsco/gazetteer-entity-parser

Rust library for parsing and resolving entity values based on a gazetteer

Gazetteer Entity Parser

THIS LIBRARY IS NOT ACTIVELY MAINTAINED ANYMORE

This Rust library allows to parse and resolve entity values based on a gazetteer, in the context of an Information Extraction task.

Example

extern crate gazetteer_entity_parser;

use gazetteer_entity_parser::*;

fn main() {
    let gazetteer = gazetteer!(
        ("king of pop", "Michael Jackson"),
        ("the rolling stones", "The Rolling Stones"),
        ("the crying stones", "The Crying Stones"),
        ("the fab four", "The Beatles"),
        ("queen of soul", "Aretha Franklin"),
    );
    let parser = ParserBuilder::default()
        .gazetteer(gazetteer)
        .minimum_tokens_ratio(2. / 3.)
        .build()
        .unwrap();

    let sentence = "My favourite artists are the stones and fab four";
    let extracted_entities = parser.run(sentence, 5);
    assert_eq!(
        extracted_entities,
        vec![
            ParsedValue {
                matched_value: "the stones".to_string(),
                resolved_value: ResolvedValue {
                    resolved: "The Rolling Stones".to_string(),
                    raw_value: "the rolling stones".to_string(),
                },
                alternatives: vec![ResolvedValue {
                    resolved: "The Crying Stones".to_string(),
                    raw_value: "the crying stones".to_string(),
                }],
                range: 25..35,
            },
            ParsedValue {
                matched_value: "fab four".to_string(),
                resolved_value: ResolvedValue {
                    resolved: "The Beatles".to_string(),
                    raw_value: "the fab four".to_string(),
                },
                alternatives: vec![],
                range: 40..48,
            }
        ]
    );
}

License

Licensed under either of

• Apache License, Version 2.0 (LICENSE-APACHE or http://www.apache.org/licenses/LICENSE-2.0)
• MIT license (LICENSE-MIT) or http://opensource.org/licenses/MIT)

at your option.

Contribution

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.