Camino Financial's Data Engineering Take Home Project

Hello and welcome to Camino Financial Data Engineering take home project!

The Mission

The mission, should you choose to accept, is to sift through some data craziness and make some sense out of them.

Getting started

Be comfortable with key concepts of data engineering.

Why a take-home?

This is a tangible way for you to show us:

  • That you know the basics of working with data
  • That you can think outside the box

The Mission Specs

1: Credit data

  • Given this json file, please design a sql table or tables that would be query-able.
  • Deliverable A: The code that does the parsing, in any language of your choice (we prefer Python 3).
  • Deliverable B: The sql schema diagram

2: ETL pipeline

  • Now imagine for a moment, we are receiving 1000 records per second. Please design an ETL data pipeline that will be able to handle this and then eventually send everything to a data warehouse ...
  • Deliverable: A diagram depicting your ETL data pipeline. Please elaborate also your tool of choice, processing frequency and cost.

Please provide your deliverable in a private repo and send to us for review.

If you have any questions, concerns or suggestions please feel free to ping us on the recruiting platform. Happy coding! Camino Financial is a pretty awesome place to work, We hope to see you soon!