workforce-data-initiative/skills-airflow

Allow switch from boto to boto3

thcrock opened this issue · 0 comments

We want to switch from boto2 to boto3, but the Airflow S3Hook.get_conn() returns a boto connection. We should abstract this out a bit, and control it the boto version through a feature switch in config, so we can update skills-ml and skills-utils independently.