Mongodb output plugin for Embulk

input source중에 지정된 필드를 subdocument로 만들어서 몽고DB로 저장한다

Dumps records to Mongodb with subdocument

Overview

Plugin type: output
Load all or nothing: no
Resume supported: no
Cleanup supported: no

Configuration

type: mongodb_nest (string, required)
host: host name (string, required)
port: port number (integer, default: 27017)
ssl enable SSL connection (boolean, default: false)
database: database name (string, required)
user: mongodb account (string, required)
password: password (string, required)
collection: collection name (string, required)
key: primary keys of collection (string array, required, since v0.1.2)
child: describe subdocument (object list, default: null)
bulk_size: bulk upsert size at time (integer, default: 10000)
null_value: set the value to fill if the field value is null (object, optional, since v0.1.3)
- string : default string value (string, default: "")
- long : default long value (long, default: 0)
- boolean : default boolean value (boolean, default: false)
- double : default double value (double, default: 0.0)
- json : default json value (object, default: "{}")
- timestamp : default timestamp value (timestamp, default : "1970-01-01T00:00:00.000Z")

Example

default configuration

out:
  type: mongodb_nest
  host: your-host-name
  database: your-database-name
  user: your-account-name
  password: your-password
  collection: your-collection-name
  key: [your-key1, key2, ...]
  child:
  - {name: mychild, field: time}
  - {name: yourchild, field: comment}
  - {name: mychild, field: purchase}
  null_value:
    string: ""
    long: -1
    json: {key: value}
    boolean: false
    double: 0.0
    timestamp: "1970-01-01T00:00:00.000Z"

Embulk input csv sample configuration

in:
  type: file
  path_prefix: /Users/focuschange/google/program/embulk/try1/csv/sample_
  decoders:
  - {type: gzip}
  parser:
    charset: UTF-8
    newline: LF
    type: csv
    delimiter: ','
    quote: '"'
    escape: '"'
    null_string: 'NULL'
    trim_if_not_quoted: false
    skip_header_lines: 1
    allow_extra_columns: false
    allow_optional_columns: false
    columns:
    - {name: id, type: long}
    - {name: account, type: long}
    - {name: time, type: timestamp, format: '%Y-%m-%d %H:%M:%S'}
    - {name: purchase, type: timestamp, format: '%Y%m%d'}
    - {name: comment, type: string}
out:
  type: mongodb_nest
  host: your-host-name
  database: your-database-name
  user: your-account-name
  password: your-password
  collection: your-collection-name
  key: [your-key, key2]
  child:
  - {name: mychild, field: time}
  - {name: yourchild, field: comment}
  - {name: mychild, field: purchase}
  null_value:
    string: ""
    long: -1
    json: {key: value}
    timestamp: "1990-01-01T00:00:00.000Z"

Release

0.1.3 2018-06-25 set the value to fill if the field value is null
0.1.2 2018-06-08 The key field has been changed to a list type. The JSON Parser is supported by the input plugin.
0.1.1 2018-06-05 [bug fix] Fiexed an error when a child field was entered
0.1.0 2018-05-31 first release

cclien/embulk-output-mongodb_nest

Mongodb output plugin for Embulk

Overview

Configuration

Example

Release