Given all of the recent issues around Facebook and the data it keeps about all of us it seemed like a good time for a tool to help us analyze the data dump Facebook is willing to give us.
Working:
- show counts of various database records that Facebook keeps about you
- show how many messages you've sent with each of your Facebook Messenger correspondants
- search for keywrods in your Facebook Messenger history
More features are planned.
There are very few dependancies to make this code work.
- Perl 5.x - nothing special or new needed
JSON::MaybeXSmodule and one of the three JSON modules it supports.
To get this on CentOS 7 I would run:
yum install perl-JSON-MaybeXS perl-JSON-XS
In Debian or Ubuntu this should work:
apt-get install libjson-maybexs-perl libjson-xs-perl
Once you've got that pre-requisite out of the way somehow you need to clone this repo:
git clone https://github.com/chicks-net/fbdata-forensics.git
cd fbdata-forensics
Get your data from Facebook. Ask for it as JSON since this tool doesn't process the HTML flavor of the data download. I've seen reports of the data taking 2-4 hours to be ready, but for me it took 28 hours:interrobang: :clock1130: :honey_pot: :zzz: I hope you aren't in a hurry.
Facebook gives you a file like facebook-username.zip.
I would rename it to facebook-username-YYYMMDD.zip. So for me it ends up being facebook-chicks-20181118.zip.
Within a copy of this repo create a directory like data.username. For me
data.chicks would be created by
mkdir data.chicks
NOTE: Any data.* directory will be hard to add to git because it is intentionally in the
.gitignore.
Then unpack your data into that directory:
cd data.chicks
unzip ~/Downloads/facebook-chicks-20181118
# zip, zip, zip
cd ..
# you should be back in the top dir of this repo
To get a high-level overview run ./json-counts with a directory of Facebook data prepared
as mentioned in the previous section. For example:
fbdata-forensics$ ./json-counts data.chicks
data.chicks looks like a Facebook data dump
- 0 marketplace entries
- 0 saved_items entries
... skipping about_you/face_recognition.json which isn't generic enough for here
... skipping about_you/friend_peer_group.json which isn't generic enough for here
... skipping about_you/your_address_books.json which isn't generic enough for here
- 0 ad interests entries
- 0 advertiser uploaded contact entries
- 4 advertiser touched entries
- 6 installed_apps entries
- 361 app_post entries
- 79 comment entries
Edit the keywords.txt file to contain the words to dig for in your messages.
Then run ./json-messages with a directory of Facebook data like so:
fbdata-forensics$ ./json-messages data.chicks/
data.chicks/ looks like a Facebook data dump
- 107 conversations found in Facebook Messages
+ 1 messages with Abe Jones (inbox)
$keyword_matches = {};
+ 1 messages with Alex Smith (inbox)
$keyword_matches = {};
+ 6 messages with Bob Smith (inbox)
$keyword_matches = {};
+ 1 messages with Carol Jones (inbox)
$keyword_matches = {};
Please file github issues for things not already planned.
Christopher Hicks is the primary author of this project. He has gotten lots of assistance and wonderful feedback so noone is pretending they are doing it all alone.