opensearch-project/data-prepper
Data Prepper is a component of the OpenSearch project that accepts, filters, transforms, enriches, and routes data at scale.
JavaApache-2.0
Pinned issues
[RFC] OpenSearch Ingestion: A New Name for the Next Steps of Data Prepper
#4309 opened by dlvenable
Open5
Issues
- 0
Variable drain time when shutting down via shutdown API
#4966 opened by dlvenable - 1
Werkzeug-2.2.3-py3-none-any.whl: 2 vulnerabilities (highest severity is: 8.0)
#4938 opened by mend-for-github-com - 1
- 0
Add support for parse_json on complex json structures with arrays and nested arrays
#4961 opened by graytaylor0 - 0
[BUG?] data-prepper sink fails to create templates when `number_of_shards` is passed
#4960 opened by egarbi - 1
Add ReplaceStringProcessor for simple string substitution that doesn't involve regex
#4953 opened by dinujoh - 0
Allow plugins to access the default pipeline role
#4958 opened by graytaylor0 - 0
- 0
Add a NOISY SLF4J marker
#4927 opened by dlvenable - 1
requests-2.31.0-py3-none-any.whl: 1 vulnerabilities (highest severity is: 5.6)
#4939 opened by mend-for-github-com - 1
urllib3-2.0.7-py3-none-any.whl: 1 vulnerabilities (highest severity is: 4.4)
#4937 opened by mend-for-github-com - 1
zipp-3.15.0-py3-none-any.whl: 1 vulnerabilities (highest severity is: 3.3)
#4936 opened by mend-for-github-com - 1
setuptools-68.0.0-py3-none-any.whl: 1 vulnerabilities (highest severity is: 7.0)
#4940 opened by mend-for-github-com - 1
Support automatic plugin loading in Data Prepper core
#4838 opened by dlvenable - 1
[BUG] Tracing index is not re-created in opensearch. Dataprepper needs restart?
#4951 opened by AdaptiveStep - 0
- 3
- 3
- 3
Concatenation for geo fields in Data Prepper?
#4916 opened by Grumpyfish1200 - 2
[BUG] Data Prepper processor workers stop running when an error from the routes occurs
#4883 opened by dlvenable - 1
[BUG] OpenSearch sink is not resuming after failures
#4932 opened by dlvenable - 2
Removes Jaeger Agent from Jaeger Hotrod Demo
#4923 opened by linghengqian - 0
Improve jar names for Data Prepper plugins
#4931 opened by dlvenable - 0
Support BigDecimal data type in expressions
#4817 opened by oeyh - 0
[BUG] S3 Scan partition ownership cannot expire with full buffer without acknowledgments enabled
#4928 opened by graytaylor0 - 0
[BUG] EVENT logging masks all inputs
#4926 opened by dlvenable - 2
Support s3 scan for bucket across regions
#4811 opened by chenqi0805 - 2
Implement Post-Processor Hooks for Refreshing Index after Ingestion
#4885 opened by SavvasSriAnushaVeeramachineni - 2
- 3
Manual approval required for workflow run 10599810682: Release Data Prepper : 2.9.0
#4882 opened by github-actions - 4
- 0
Automate the DataPrepperVersion from Gradle
#4877 opened by dlvenable - 2
Pipeline processor/feature to ingest document in Opensearch's time based indices based on time field of incoming record
#4832 opened by akshay0709 - 0
Using Custom class to handle collection of error messages from PluginErrorCollector
#4854 opened by chenqi0805 - 2
[BUG] Close Opensearch RestHighLevelClient in OpenSearchClientRefresher on shutdown and initialization failure
#4770 opened by dinujoh - 0
[BUG] Visibility duplication protection fails when using S3 source for large files and receiving 10 messages from SQS queue
#4812 opened by danhli - 1
[BUG] Expression tries to evaluate something as a string when it should evaluate it as an object
#4859 opened by miguel-vila - 2
- 1
[BUG] DynamoDB Leader Thread can crash if it fails to save state for the leader partition
#4775 opened by graytaylor0 - 1
- 1
S3 buffer using pipeline transformations
#4809 opened by dlvenable - 0
[BUG] Service-map relationship should be created regardless of missing traceGroupName
#4821 opened by chenqi0805 - 1
Allow pipeline configuration files to reference and utilize environment variables
#4813 opened by dangube4ever - 0
Personalize as Sink
#4804 opened by ivan-tse - 0
[BUG] dlq object should include the dynamic index runtime value instead of the literal value in pipeline configuration
#4808 opened by chenqi0805 - 3
Manual approval required for workflow run 10207697004: Release Data Prepper : 2.8.1
#4806 opened by github-actions - 3
Manual approval required for workflow run 10207064949: Release Data Prepper : 2.8.0
#4802 opened by github-actions - 2
Add sinks under extensions
#4799 opened by kkondaka - 0
- 0
[BUG] Data Prepper strings do not support $
#4772 opened by dlvenable