How to use

First use

For fisrt usage, you need to build image docker.

docker-compose build

Quick start

docker network create nw_twint
docker-compose up -d elasticsearch
sleep 10
docker-compose up -d searchapp
docker-compose run twint -u noneprivacy -es elasticsearch:9200 --json -o /opt/twint/noneprivacy.json
open http://localhost:3000

Twint, Elasticsearch & Searchapp

Start to up elaticsearch and searchapp

docker network create nw_twint
docker-compose up -d elasticsearch searchapp twint

Execute Twint command

docker network create nw_twint
docker-compose run -v $PWD/output:/srv/twint twint {{CMD TWINT}}

Examples of command

A few simple examples to help you understand the basics:

docker-compose run twint -u username -es elasticsearch:9200
docker-compose run twint -s "#osint" -es elasticsearch:9200
docker-compose run twint -u username -es elasticsearch:9200 --json -o /opt/twint/username.json
USERNAME=username docker-compose run twint -u ${USERNAME} -es elasticsearch:9200 --json -o /opt/twint/${USERNAME}.json

if local install of twint

twint -u username -es localhost:9200
twint -u username -es localhost:9200 --json -o /opt/twint/username.json

Search engine

Allows to do faceted search
Current build is developpment so you can do change and re-compile in real-time.

open http://localhost:3000

Debug Elasticsearch

open http://localhost:9000
open http://localhost:9200/twinttweets/_search?pretty=true&q=*:*
open http://localhost:9200/twinttweets/_count?pretty

Screenshots

Known Issues ⚠️

I have noticed when running the new 5.0+ version on a linux host you need to increase the memory map areas with the following command

sudo sysctl -w vm.max_map_count=262144

More at https://www.elastic.co/guide/en/elasticsearch/reference/current/docker.html

Issues

Find a bug? Want more features? Find something missing in the documentation? Let me know! Please don't hesitate to file an issue

To do

Embed video in tweets
Tweet with images
Tweet with location
Filter re-tweets
All the most crazy things possible

twintproject/twint-search