Data Quality Assurance Stack

Question

Data Quality Assurance Stack

Opened this issue 9 months ago · 7 comments

Ensuring Data Quality with Airbyte, dbt, and Great Expectations.

Extract data using Airbyte, transform it using dbt, and utilize Great Expectations to validate data quality, ensuring the reliability and accuracy of your analytical data.

How to get started:

Check out the README and the Contribution instructions in this repo.
Check one of the existing quickstarts and observe their structure.
(Optional, but highly recommended) Implement one of the quickstarts by following the instructions in their README. I recommend starting with E-commerce analytics in BigQuery

Answer 1 · 2023-10-03T07:51:59.000Z

Hey, @ThaliaBarrera, I would like to work on this. Can you please assign it to me?

Answer 2 · 2023-10-03T17:45:31.000Z

Hi @gauriimaheshwarii! Sure, I have assigned it to you.

Answer 3 · 2023-10-10T16:04:51.000Z

Hi @gauriimaheshwarii, this message is just to remind you that according to the Hackathon rules you have 5 days to submit progress on the issue. I’ll give you a couple more days to submit a PR, otherwise I’ll have to mark the issue as “To be Claimed” or reassign it.

Thank you for understanding! Let me know if you have any questions.

Answer 4 · 2023-10-13T20:19:33.000Z

This is interesting, can I add an orchestrator as Airflow or this is supposed to be standalone?

Answer 5 · 2023-10-14T15:52:58.000Z

You can certainly add an orchestrator @1cadumagalhaes! I have assigned the issue to you. Let me know if that’s okay.

Answer 6 · 2023-10-14T22:33:35.000Z

Yeah, thanks!

Answer 7 · 2023-10-25T09:39:02.000Z

Hi @1cadumagalhaes! are you still working on this? 🙂