/labs-csv-json-sm

Smartmodule to convert csv files to json format.

Primary LanguageRustApache License 2.0Apache-2.0

Fluvio SmartModules

This smartmodule converts CSV records to JSON records.

You can test this smartmodule with the following steps:

$ fluvio cluster start 
$ smdk build
$ smdk load
$ fluvio topic create csv-json-topic
$ fluvio consume csv-json-topic --smartmodule=infinyon-labs/csv-json@0.2.0 -e delimiter=";" -e header_case=snake

In another terminal:

$ fluvio produce csv-json-topic -f ./test-data/semicolon-snake/input.csv --raw

Params

  • delimiter: The delimiter used in the CSV file. Default is ,.
  • header_case: The case of the header. Default is none. Possible values are snake, camel, none.

Tests

Checkout the makefile for the tests