ETL based on cloud function (google cloud) that retrieves data from the Facebook Insight API:
AdsInsights.Field.account_id, AdsInsights.Field.campaign_id, AdsInsights.Field.campaign_name, AdsInsights.Field.adset_name, AdsInsights.Field.adset_id, AdsInsights.Field.ad_name, AdsInsights.Field.ad_id, AdsInsights.Field.spend, AdsInsights.Field.impressions, AdsInsights.Field.clicks, AdsInsights.Field.actions, AdsInsights.Field.conversions
And Currency exchange rate from currencylayer.com.
ETL uploads this data to Google Bigquery every day.
These instructions will get you a copy of the project up and running on your google cloud project for development and testing purposes.
A step by step series of examples that tell you how to get a development env running
Create new pubsub topic:
gcloud pubsub topics create facebook_runPublish cloud function:
gcloud functions deploy get_facebook_data --runtime python37 --trigger-topic facebook_run --timeout=540 --memory=1024MBCreate scheduler for facebook ads ETL:
PROJECT_ID = your google cloud PROJECT_ID DATASET_ID = for example "facebook" TABLE_ID = for example "fb_stat" ACCOUNT_ID = your facebook account id without act_
APP_ID, APP_SECRET, APP_TOKEN = from apps developers.facebook.com
gcloud beta scheduler jobs create pubsub facebook --time-zone "Europe/Kiev" --schedule "0 5 * * *" --topic facebook_run --message-body "get_facebook_data" --attributes project_id=PROJECT_ID,dataset_id=DATASET_ID,table_id=TABLE_ID,account_id=ACCOUNT_ID,app_id=APP_ID,app_secret=APP_SECRET,access_token=ACCESS_TOKENCreate scheduler for currency converter:
gcloud beta scheduler jobs create pubsub converter --time-zone "Europe/Kiev" --schedule "0 5 * * *" --topic facebook_run --message-body "get_currency" --attributes project_id=PROJECT_ID,dataset_id=DATASET_ID,table_id=TABLE_ID,api_key=API_KEY,from_currency=USD,to_currency=UAH-
Andrey Osipov
This project is licensed under the MIT License - see the LICENSE.md file for details