Missing connectors in benthos 4.40.0

[artemklevtsov]

Describe the bug

benthos does not have many connectors.

Steps To Reproduce

❯ benthos --version                         
Version: 4.40.0
Date: unknown
❯ benthos list --format json inputs
{"inputs":["batched","broker","csv","dynamic","file","generate","http_client","http_server","inproc","read_until","resource","sequence","socket","socket_server","stdin","subprocess","websocket"]}

Expected behavior

❯ redpanda-connect --version                
Version: 4.39.0
Date: 2024-11-07T18:58:48Z
❯ redpanda-connect list --format json inputs 
{"inputs":["amqp_0_9","amqp_1","aws_kinesis","aws_s3","aws_sqs","azure_blob_storage","azure_cosmosdb","azure_queue_storage","azure_table_storage","batched","beanstalkd","broker","cassandra","cockroachdb_changefeed","csv","discord","dynamic","file","gcp_bigquery_select","gcp_cloud_storage","gcp_pubsub","generate","hdfs","http_client","http_server","inproc","kafka","kafka_franz","mongodb","mqtt","nanomsg","nats","nats_jetstream","nats_kv","nats_stream","nsq","ockam_kafka","parquet","pulsar","read_until","redis_list","redis_pubsub","redis_scan","redis_streams","redpanda","redpanda_common","redpanda_migrator","redpanda_migrator_bundle","resource","schema_registry","sequence","sftp","socket","socket_server","spicedb_watch","splunk","sql_raw","sql_select","stdin","subprocess","timeplus","twitter_search","websocket"]}

Screenshots

Additional context

Metadata

Notify maintainers

@sagikazarmark

---

Note for maintainers: Please tag this issue in your PR.

---

Add a 👍 reaction to issues you find important.

[sagikazarmark]

I suspect it's because they've been removed from the core and moved to Redpanda.

Not sure what's the right solution here to be honest.

The way Redpanda took over Benthos was controversial and there are still unanswered questions: redpanda-data/benthos#8

Given Redpanda Connect is open source, I think the best path forward is adding that to nixpgs as well: https://github.com/redpanda-data/connect

[artemklevtsov]

I posted issue about redpanda-connect: #325717
I think this will solve the current issue.

[sagikazarmark]

I think benthos can stay as it is then, although it's probably not very useful in its current form.