/wikigraph

Expedite your next "Wikipedia rabbit-hole" by using this compiled database of over 300 million article relationships to interactively explore and traverse all of humanity's knowledge.

Primary LanguageTypeScript

Getting Setup

  • Run yarn to install packages
  • Download pages multistream torrent from metawiki site
  • After unzipping, rename the file to wiki.xml and move it into the data folder for further processing
  • Then run yarn db:csv to convert the XML to CSV
  • Then run yarn db:init to build the database file
  • Then run sqlite3 wiki.db
    • .mode csv
    • .import links.csv links
    • run CREATE INDEX idx_from_title ON links (from_title);
  • Go to the backend folder
    • Add an .env file with a your DB's file path as the value for DB_FILE
    • Run yarn watch to start the server
  • Go to the frontend folder
    • Create a .env.local file with the following: VITE_API_URL=http://localhost:8000/api
    • Run yarn dev to start the website