/PoliScrape

2016 UNC Archival Text Analysis Web Scraper Project

Primary LanguageJulia

#PoliScrape PoliScrape: a foreign policy archival document collection tool. Author: Ryan Steed

Version 1

2016-Oct-13, Chapel Hill, NC

PoliScrape is an archival web scraper that collects, searches and analyzes foreign policy documents.

Features

  • Summary of available foreign policy databases
  • Search and analysis capability descriptions
  • Scrapy web crawler that collects HTML text data from web sources
  • Modern web and mobile interface
  • Run in all major browsers without plugins

Future Goals

  • Apply text analysis tools of open source projects like Lemur to conduct local analysis