/mailchimp_plugin

Primary LanguagePythonApache License 2.0Apache-2.0

Plugin - Mailchimp to S3

This plugin moves data from the Mailchimp API to S3. Implemented for camapigns, connected-sites connected-sites-details, conversations, conversations-details, lists, lists-details, reports, reports-details.

Hooks

MailchimpHook

This hook handles the authentication and request to Mailchimp. Based on python-mailchimp

S3Hook

Core Airflow S3Hook with the standard boto dependency.

Operators

MailchimpToS3Operator

This operator composes the logic for this plugin. It fetches a specific endpoint and saves the result in a S3 Bucket, under a specified key, in njson format. The parameters it can accept include the following.

  • mailchimp_conn_id: The Airflow id used to store the Mailchimp credentials.
  • mailchimp_resource: The mailchimp resource we are fetching data from.
  • mailchimp_args: Mailchimp extra args
  • s3_conn_id: S3 connection id from Airflow.
  • s3_bucket: The output s3 bucket.
  • s3_key: The input s3 key.
  • s3_bucket: The s3 bucket where the result should be stored