Low-Latency Data Availability Stack

Question

Low-Latency Data Availability Stack

Closed this issue a year ago · 13 comments

Achieving Low-Latency Data Availability with Logical Replication from Postgres using Airbyte.

Configure Airbyte with logical replication to facilitate low-latency data availability from a Postgres database, ensuring near real-time data access and enhancing responsiveness for analytical queries and applications.

How to get started:

Check out the README and the Contribution instructions in this repo.
Check one of the existing quickstarts and observe their structure.
(Optional, but highly recommended) Implement one of the quickstarts by following the instructions in their README. I recommend starting with E-commerce analytics in BigQuery

Answer 1 · 2023-10-04T12:29:24.000Z

Hello @ThaliaBarrera I'd like to give a shot a this, please assign me

Answer 2 · 2023-10-04T21:14:34.000Z

Hi @cannarron! Sure, I have assigned it to you.

Answer 3 · 2023-10-10T16:00:38.000Z

Hi @cannarron, this message is just to remind you that according to the Hackathon rules you have 5 days to submit progress on the issue. I’ll give you a couple more days to submit a PR, otherwise I’ll have to mark the issue as “To be Claimed” or reassign it.

Thank you for understanding! Let me know if you have any questions.

Answer 4 · 2023-10-11T07:01:10.000Z

Thank you for the update Thalia, I am actually done with the quickstart draft, can I submit that here for you to take a look. Also, by PR do you mean a completed document I'd like to understand better Thank you so much Regards

…

On Tue, 10 Oct 2023, 5:00 pm ThaliaBarrera, ***@***.***> wrote: Hi @cannarron <https://github.com/cannarron>, this message is just to remind you that according to the Hackathon rules you have 5 days to submit progress on the issue. I’ll give you a couple more days to submit a PR, otherwise I’ll have to mark the issue as “To be Claimed” or reassign it. Thank you for understanding! Let me know if you have any questions. — Reply to this email directly, view it on GitHub <#14 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ASTCD5ZVR4NXAACYY7WBFJLX6VWLBAVCNFSM6AAAAAA5ICDKUWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONJVG42TAOBRGQ> . You are receiving this because you were mentioned.Message ID: ***@***.***>

Answer 5 · 2023-10-12T15:44:48.000Z

Hi @cannarron, by PR I mean opening a pull request to the repo. You can check the ones that have been submitted and merged before. The instructions are in the README.

Let me know if you have questions!

Answer 6 · 2023-10-19T17:22:19.000Z

I am unassigning this issue as there has been no progress in the last 5 days. This is now open!

Answer 7 · 2023-10-21T03:05:18.000Z

@ThaliaBarrera : can you please assign this to me?

Answer 8 · 2023-10-21T09:21:26.000Z

Hi @sowmiyaksr! Sure, I have assigned it to you. Let me know if you have questions.

Answer 9 · 2023-10-22T07:15:11.000Z

@ThaliaBarrera : is "Low latency Data Availability Stack" can be created using CDK?

Answer 10 · 2023-10-23T13:27:12.000Z

@ThaliaBarrera : is "Low latency Data Availability Stack" can be created using CDK?

Hi @sowmiyaksr! The idea of the quickstarts is to use existing Airbyte connectors via the UI or Terraform, so the CDK wouldn't apply here. What did you want to use the CDK for?

Answer 11 · 2023-10-30T17:09:51.000Z

I'm unassigning this issue since there has been no progress in the last 5 days. Let me know if you still want to work on this @sowmiyaksr, otherwise, it's to be claimed.

Answer 12 · 2023-10-31T23:33:03.000Z

Can I pick this up @ThaliaBarrera

Answer 13 · 2023-11-01T15:32:26.000Z

Sure @topefolorunso!