azhe1234/TeBaQA

A question answering system which utilises machine learning.

Template-Based Question Answering (TeBaQA)

TeBaQA is available at https://tebaqa.demos.dice-research.org/

Execution

TeBaQA implements microservices architecture. The application comprises following 5 modules:

• Template Classification :- to classify query templates (localhost:8081)
• Entity Linking :- finding and linking entities and relations (localhost:8082)
• Query Ranking :- candidate query execution, ranking (localhost:8083)
• TeBaQA Controller :- central controller, frontend application (localhost:8080)
• NLP Server :- CoreNLP Server endpoint (localhost:8085)

Additionally, Entity Linking requires Elasticsearch indices for data and ontology of the knowledge base. Check this file for more information on creating your own indices.

There are two ways to run TeBaQA

1. Run locally

• Checkout the project

• Build all modules

  ./build-script.sh

• Run all modules

  ./run-script.sh

2. Run as Docker (installation guide, Ubuntu 20.04) containers

• Checkout the project

• Build docker images for each module

  ./docker/build-images.sh

• To run all containers

  ./docker/run-containers.sh

• To stop all containers

  ./docker/stop-containers.sh

Citation

Vollmers, D., Jalota, R., Moussallem, D., Topiwala, H., Ngomo, A. C. N., & Usbeck, R. (2021). Knowledge Graph Question Answering using Graph-Pattern Isomorphism. arXiv preprint arXiv:2103.06752. https://arxiv.org/abs/2103.06752

Question Answering

• To answer a question, simply execute an HTTP POST request to
  • http://localhost:8080/qa for the answer which follows the W3C Query Results JSON Format (see https://www.w3.org/TR/sparql11-results-json/).
  • http://localhost:8080/qa-simple for a simple JSON with only the answer.
• Parameters:
  • query: A string which contains a question (required).
  • lang: The language of the question (default:en) Note: Other languages than English haven't been implemented yet.
• An example request could look like this:
  • http://localhost:8181/qa?query=What is the original title of the interpretation of dreams?&lang=en

Evaluation

• QALD-8: http://gerbil-qa.cs.upb.de:8080/gerbil/experiment?id=202012090005
• QALD-9: http://gerbil-qa.cs.upb.de:8080/gerbil/experiment?id=202012050000
• LC-QUAD v1: http://gerbil-qa.cs.upb.de:8080/gerbil/experiment?id=202012160002
• LC-QUAD v2: http://gerbil-qa.cs.upb.de:8080/gerbil/experiment?id=202103220000

Ablation study

• perfect Classification: http://gerbil-qa.cs.upb.de:8080/gerbil/experiment?id=202012070002
• perfect Classification and Entity Linking: http://gerbil-qa.cs.upb.de:8080/gerbil/experiment?id=202012090000
• perfect Classification and Ranking: http://gerbil-qa.cs.upb.de:8080/gerbil/experiment?id=202012090001
• perfect Entity Linking: http://gerbil-qa.cs.upb.de:8080/gerbil/experiment?id=202012070004
• perfect Entity Linking and Ranking: http://gerbil-qa.cs.upb.de:8080/gerbil/experiment?id=202012080001
• perfect Ranking: http://gerbil-qa.cs.upb.de:8080/gerbil/experiment?id=202012080000
• perfect Entity Classification,Entity Linking and Ranking: http://gerbil-qa.cs.upb.de:8080/gerbil/experiment?id=202012080002

Credit

• DBpedia Chatbot: Styling of the result cards.