Pubsub Source

Question

Pubsub Source

dovy opened this issue 8 years ago · 8 comments

Can I use pubsub yet? I know we don't have "streaming", but I thought that was waiting after a pubsub topic was empty.

I need to use pubsub as my source, or put a router in front, or I can't even use Dataflow yet. :(

Not going to use Java over here...

Answer 1 · 2016-07-22T22:49:34.000Z

This is currently not supported as an SDK primitive but is on our roadmap. You can, however, shell out to the gcloud PubSub CLI in a ParDo and send messages that way. When you run commands this way, API calls will execute as your GCP project's Compute Engine service account. This way, you can publish messages through this CLI tool. This workaround should work, but it isn't officially supported.

Answer 2 · 2016-07-22T22:56:18.000Z

Care to provide any examples? I'd love to implement this asap. :)

Answer 3 · 2016-07-22T22:57:25.000Z

See, for example: https://cloud.google.com/sdk/gcloud/reference/alpha/pubsub/ and https://cloud.google.com/sdk/gcloud/reference/alpha/pubsub/topics/publish

Answer 4 · 2016-07-22T22:59:09.000Z

My bad, I meant the reverse way. I want to process pubsub as a source... Have to get my terminology down.

Answer 5 · 2016-07-22T23:02:56.000Z

Ah. No, sorry, this functionality isn't available yet, and is on our streaming roadmap.

Answer 6 · 2016-07-22T23:06:39.000Z

Any form of an ETA? heh.

Answer 7 · 2016-07-23T02:59:42.000Z

Sorry, I can't provide one here.

Answer 8 · 2016-07-23T04:34:36.000Z

Email? Slack? ;). Dovy@owletcare.com