snowplow/emr-etl-runner

Issues

• Do not submit RDB Loader step if messageQueue is present in Redshift config

  #82 opened 4 years ago by chuwy
  0

• Not add/add S3DistCp for shredded JSONs and shredded TSVs depending on the configuration

  #71 opened 4 years ago by chuwy
  4

• Update config.yml with latest recommended settings

  #79 opened 4 years ago by chuwy
  0

• EmrEtlRunner: add config.yml lint

  #42 opened 4 years ago by chuwy
  4

• EmrEtlRunner: update initialization logic for "Shredded JSON/TSV types HDFS -> S3" steps

  #20 opened 4 years ago by stdfalse
  4

• Disable retry on failure of the rdb_load step

  #76 opened 4 years ago by istreeter
  0

• Fix ParamContractError when copying shredded types to S3

  #74 opened 4 years ago by istreeter
  0

• EmrEtlRunner: Catch and retry EMR connection issues

  #70 opened 4 years ago by istreeter
  1

• Undefined local variable bug

  #72 opened 4 years ago by istreeter
  0

• Handle step failures by resubmitting the jobflow

  #63 opened 4 years ago by istreeter
  0

• Fix default diplomat arguments

  #65 opened 5 years ago by peel
  0

• Catch and retry EMR connection issues

  #4 opened 5 years ago by istreeter
  0

• Extend copyright to 2020

  #62 opened 5 years ago by peel
  0

• Bump diplomat to 2.4.0

  #14 opened 5 years ago by peel
  0

• Bump rest-client to 1.8.0

  #15 opened 5 years ago by peel
  0

• Bump upstream dependencies

  #16 opened 5 years ago by peel
  0

• Bump snowplow-tracker to 0.6.1

  #11 opened 5 years ago by peel
  0

• Bump iglu-ruby-client to 0.2.0

  #12 opened 5 years ago by peel
  0

• Bump aws-sdk-s3 to 1.66.0

  #13 opened 5 years ago by peel
  0

• Bump rspec to 3.9.0

  #8 opened 5 years ago by peel
  0

• Bump awrence to 1.1.1

  #10 opened 5 years ago by peel
  0

• Bump avro to 1.9.2

  #9 opened 5 years ago by peel
  0

• Bump jruby to 9.2.11.1

  #7 opened 5 years ago by peel
  0

• Add travis configuration

  #3 opened 5 years ago by peel
  0

• EmrEtlRunner: replace Gemfile and Bundler with JRuby/Gradle

  #44 opened 8 years ago by alexanderdean
  2

• EmrEtlRunner/StorageLoader: support LZO compression for enriched events?

  #43 opened 8 years ago by alexanderdean
  0

• EmrEtlRunner: enable `generate` command

  #41 opened 7 years ago by BenFradet
  0

• EmrEtlRunner: add RDB Loader step when generating playbooks

  #40 opened 7 years ago by BenFradet
  0

• EmrEtlRunner: support Spark jobs when generating playbooks

  #39 opened 7 years ago by BenFradet
  0

• EmrEtlRunner: add option to lint storage targets

  #38 opened 7 years ago by BenFradet
  0

• EmrEtlRunner: remove bootstrap action fixing common-codecs dependency for AMI 5+

  #37 opened 7 years ago by chuwy
  8

• EmrEtlRunner: drop support for the Scalding-based pipeline

  #36 opened 7 years ago by BenFradet
  3

• EmrEtlRunner: refuse to pass outdated storage target configurations to RDB Loader

  #35 opened 7 years ago by chuwy
  4

• EmrEtlRunner: short-circuit on EMR INTERNAL_ERROR

  #34 opened 7 years ago by BenFradet
  1

• EmrEtlRunner: add support of RDB Loader 0.15.0

  #33 opened 7 years ago by chuwy
  1

• EmrEtlRunner: consider supporting spot instances

  #32 opened 7 years ago by BenFradet
  1

• intermittent S3DistCp failures

  #31 opened 7 years ago by leonmaas
  1

• EmrEtlRunner: delete enrich.versions from stream_config.yml.sample

  #30 opened 7 years ago by chuwy
  0

• EmrEtlRunner: find further memory optimisations

  #29 opened 6 years ago by alexanderdean
  2

• EmrEtlRunner: replace elasticity by the aws-sdk

  #28 opened 6 years ago by BenFradet
  1

• EmrEtlRunner: bump transient dependency nokogiri to ~> 1.8.5

  #27 opened 6 years ago by BenFradet
  0

• EmrEtlRunner: bump transient dependency rubyzip to ~> 1.2.2

  #26 opened 6 years ago by BenFradet
  0

• EmrEtlRunner: add support for emitting Jobflow spec as custom context

  #25 opened 6 years ago by jbeemster
  1

• EmrEtlRunner: make format options more explicit in config example

  #24 opened 6 years ago by jbeemster
  0

• EmrEtlRunner: investigate possibility of deploying cluster across multiple subnets and AZs

  #23 opened 6 years ago by jbeemster
  0

• EmrEtlRunner: do not fail if there is only bad data

  #22 opened 6 years ago by BenFradet
  0

• EmrEtlRunner: add support of EVENTS_MANIFEST purpose for storage targets

  #21 opened 6 years ago by chuwy
  0

• EmrEtlRunner: Allow ec2_key_name to be undefined in config

  #19 opened 5 years ago by istreeter
  0

• EmrEtlRunner: Adding arguments to bootstrap actions

  #18 opened 5 years ago by GabeL7r
  0

• EmrEtlRunner: set master_instance_type and core_instance_type to m4.medium in example config

  #17 opened 5 years ago by benjben
  0