@Stashorizer is a bot that automatically downloads images from tweets in which its name is mentioned in. If the image passes a safety check for adult content, violence, etc. then the bot will attempt to find faces in the image and draw mustaches on each face. The bot will then reply with a mustache drawn over the original image. Hopefully the mustache will appear below the nose but often it will appear somewhere else.

This bot uses the following APIs:

Tweepy - to interact with Twitter
Google Cloud Vision - to check image safety
Rollbar - for logging and error monitoring
MapR - for archiving the Twitter stream and replicating to Mastodon

BUILD

git push -u origin master
docker build --no-cache -t iandow/stashorizer .
docker push iandow/stashorizer

USAGE:

Define the following environment variables in ~/env-file:

Required:

TW_USERNAME=
TW_CONSUMER_KEY=
TW_CONSUMER_SECRET=
TW_ACCESS_TOKEN=
KAFKA_REST_URL=
ROLLBAR_ACCESS_KEY=
GOOGLE_APPLICATION_CREDENTIALS=

Optional:

KAFKA_REST_URL=
DEBUG=

Here's what an example env-file might look like. The keys and secrets shown below are fake. I just put them here so you know how the format should look:

TW_USERNAME=stashorizer
TW_CONSUMER_KEY=23e0d55913808d0b813c8dc08
TW_CONSUMER_SECRET=08d0b81323e0d55913808d0b813c8dc0808d0b81308d0b8132
TW_ACCESS_TOKEN=ad838460bfd641ab7f5-460bfd641ab7f5d76ed5adb91ADADX
TW_ACCESS_TOKEN_SECRET=36530de11f9f657f0821356652448ce536530de11f9f6
ROLLBAR_ACCESS_KEY=36530de11f9f657f0821356652448ce5
GOOGLE_APPLICATION_CREDENTIALS=/root/certs/my-project-98793e12f.json
DEBUG=False
KAFKA_REST_URL=http://nodea:8082/topics/%2Fapps%2Fstashorizer%3Amentions

You'll need to link your Google Cloud certificate to container. I do that by copying my json cert file to ~/certs/ and mapping directory that to the container as a docker volume, like this:

docker pull iandow/stashorizer
docker run -dit --restart unless-stopped --env-file ~/env-file --name stashorizer -v ~/certs/:/root/certs/ iandow/stashorizer:latest

Tweet storage in MapR

The Twitter stream listener in streaming_mustache_bot.py will persist every received mention to a topic in MapR Event Streams using a Kafka REST service running on a MapR cluster node. This ensures that all @stashorizer mentions will be saved even if they're deleted from Twitter or if Twitter disables the bot account. This stream also enables us to replicate the bot elsewhere, such as Mastodon (e.g. []botsin.space](http://botsin.space)).

To do enable tweet storage to MapR, do the following:

Define the KAFKA_REST_URL environment variable to point to the Kafka REST service running on a MapR server.
Create MapR-ES stream with public write permissions and a TTL of 0 (meaning data is never purged):

# Create the stream
maprcli stream create -path /apps/stashorizer
# Create the topic
maprcli stream topic create -path /apps/stashorizer -topic mentions -partitions 3
# Enable public write permissions and an infinite Time-To-Live (TTL)
maprcli stream edit -path /apps/stashorizer -produceperm p -consumeperm p -topicperm p --ttl 0

Validate that you can produce a message, like this:

echo "hello world" | base64 | xargs -I {} curl -X POST -H "Content-Type: application/vnd.kafka.v1+json" --data '{"records":[{"value":"{}"}]}' "http://nodea:8082/topics/%2Fapps%2Fstashorizer%3Amentions"

Validate that you can read from the stream using the kafka console consumer, like this:

/opt/mapr/kafka/kafka-1.0.1/bin/kafka-console-consumer.sh --topic /apps/stashorizer:mentions --new-consumer --bootstrap-server this.will.be.ignored:9092 --from-beginning

Continuous Delivery with WebHooks

I automatically restart docker containers for @stashorizer when I push new images to the stashorizer repo on Docker hub. I accomplish this by using a webhook I created in said docker repo which sends push notifications to a public URL provided by ngrok that tunnels into the webhook tool I have running on my private twitter bot server. Here are the commands I use for ngrok and webhook:

Run the following commands on the server(s) running the twitter bot:

ngrok http 4567

Update the web hook URL on Docker Hub with whatever ngrok outputs. Then run a webhook listener like this:

./webhook-linux-amd64/webhook -port 4567 -hooks hooks.json -verbose

hooks.json looks like this:

[
  {
    "id": "redeploy-webhook",
    "execute-command": "/var/scripts/redeploy.sh",
    "command-working-directory": "/var/webhook"
  }
]

/var/scripts/redeploy.sh looks like this:

#!/bin/sh
docker pull iandow/stashorizer
docker stop stashorizer
docker rm stashorizer
docker run -dit --restart unless-stopped --env-file ~/env-file --name stashorizer -v ~/certs/:/root/certs/ iandow/stashorizer:latest