Wikiminer

Introduction

A java based wikipedia data crawer project. Specifically designed to download people and film wikidata json files from query.json file created with wikidata query service.

Goals

  • search and download wikidata json
  • update database records from wikidata id
  • periodically crawl movie, tv, people data to update
  • generate databse to be used by movie db project
  • provide API to integrate with movie db