Download, ingest, and analyze the Phoenix and ICEWS event datasets.
The Phoenix event data set records social and political events
automatically extracted from news reporting. phoxy provides
functions to make acquiring and analyzing this event data easier. For more
information about Phoenix, see its website here:
http://phoenixdata.org/ and the website of the Open Event Data
Alliance here: http://openeventdata.org/. phoxy
also includes basic functionality for working with the
ICEWS event dataset.
phoxy, like the Phoenix event dataset, is still under beta development and will
change greatly. Bug reports are welcome.
devtools::install_github("ahalterman/phoxy")
Currently, phoxy includes the following functions:
-
download_phoenixtakes a directory path and version number and downloads the entire Phoenix dataset (of that version) from http://phoenixdata.org/data into the given directory. It currenty accepts two versions: "current" and "v0.1.0". -
download_icewstakes a directory path and downloads the entire ICEWS event dataset from https://dataverse.harvard.edu/dataverse/icews. -
update_phoenixtakes a directory path that contains Phoenix files and downloads any of the daily updates that are missing from the directory. Running it on an empty directory is equivalent to runningdownload_phoenix, and running it daily will make sure you always have yesterday's data downloaded. -
ingest_phoenixreads in each daily text file from that directory, does some basic column name and class fixing, and combines them all into one large dataframe for easy analysis. -
ingest_icewsreads in a directory of files containing the ICEWS event dataset. -
convert_cameowill translate from CAMEO event codes to the human readable definitions taken from the CAMEO codebook.
Example:
download_phoenix("~/OEDA/phoxy_test/", phoenix_version = "current")
events <- ingest_phoenix("~/OEDA/phoxy_test/")
> str(events)
Classes ‘tbl_df’, ‘tbl’ and 'data.frame': 699429 obs. of 26 variables:
$ EventID : chr "0_v0.2.0" "1_v0.2.0" "2_v0.2.0" "3_v0.2.0" ...
$ Date : Date, format: "2014-06-20" "2014-06-20" "2014-06-20" "2014-06-16" ...
$ Year : int 2014 2014 2014 2014 2014 2014 2014 2014 2014 2014 ...
$ Month : int 6 6 6 6 6 6 6 6 6 6 ...
$ Day : int 20 20 20 16 20 20 19 20 20 20 ...
$ SourceActorFull : chr "THA" "INDPTY" "ESPCOP" "IMGMUSISI" ...
$ SourceActorEntity : chr "THA" "IND" "ESP" "IMG" ...
$ SourceActorRole : chr "" "PTY" "COP" "" ...
$ SourceActorAttribute: chr "" "" "" "MUS;ISI" ...
$ TargetActorFull : chr "USA" "IND" "IMGMUSISI" "TUR" ...
$ TargetActorEntity : chr "USA" "IND" "IMG" "TUR" ...
$ TargetActorRole : chr "" "" "" "" ...
$ TargetActorAttribute: chr "" "" "MUS;ISI" "" ...
$ EventCode : chr "043" "010" "010" "130" ...
$ EventRootCode : chr "04" "01" "01" "13" ...
$ PentaClass : chr "1" "0" "0" "3" ...
$ GoldsteinScore : num 2.8 0 0 -4.4 0 9 8 0 3.4 7 ...
$ Issues : chr "" "" "SECURITY_SERVICES,1" "NAMED_TERROR_GROUP,1" ...
$ Lat : num 25.5 28.6 40.4 39.9 39.8 ...
$ Lon : num 51.2 77.2 -3.7 32.9 -98.5 ...
$ LocationName : chr "State of Qatar" "New Delhi" "Madrid" "Ankara" ...
$ StateName : chr "" "National Capital Territory of Delhi" "Comunidad de Madrid" "Ankara" ...
$ CountryCode : chr "QAT" "IND" "ESP" "TUR" ...
$ SentenceID : chr "53a492ef421aa9436ba6d1e0_3" "53a49741421aa9435ea6d25e_1" "53a4943e421aa94379a6d2ea_6" "53a492e5421aa94369a6d1c5_5" ...
$ URLs : chr "http://www.theguardian.com/global-development/2014/jun/20/thailand-qatar-downgraded-human-trafficking-report" "http://www.thehindu.com/news/national/hindi-issue-cong-advises-caution-says-backlash-in-nonhindi-states/article6133644.ece?utm_"| __truncated__ "http://rss.nytimes.com/c/34625/f/640334/s/3b920a70/sc/11/l/0L0Snytimes0N0C20A140C0A60C170Cworld0Ceurope0Cspanish0Epolice0Etarge"| __truncated__ "http://www.ipsnews.net/2014/06/turkeys-kurdish-problem-likely-worsen-isis-gains-iraq/?utm_source=rss&utm_medium=rss&utm_campaig"| __truncated__ ...
$ NewsSources : chr "guardian_americas" "hindu_nat" "nyteurope" "ips_hr" ...