ray-project/ray_beam_runner

Issues

• OOM while running with a large number of HDFS files

  #62 opened 2 years ago by wilsonwang371
  0

• Rename immutable context managers to *Context

  #28 opened 2 years ago by pabloem
  4

• Create an Arrow Coder for Beam that allows us to create Ray Datasets

  #17 opened 2 years ago by pabloem
  3

• Aggregate metrics within the main thread

  #47 opened 2 years ago by pabloem
  1

• Add watermark-based scheduling to the Ray Runner

  #15 opened 2 years ago by pabloem
  3

• Running TFX tests failed with error

  #60 opened 2 years ago by wilsonwang371
  3

• Resource leak in tests

  #35 opened 2 years ago by iasoon
  3

• Standardize how we fix serialization problems for Protobufs

  #29 opened 2 years ago by pabloem
  6

• Prototype expansion of SQL transforms for single-node execution

  #59 opened 2 years ago by pabloem
  5

• Design a path for work items to report progress

  #55 opened 2 years ago by pabloem
  3

• Support the runner-requested-split path for SDF

  #22 opened 2 years ago by pabloem
  3

• "Store Benchmark Results" task is broken

  #46 opened 2 years ago by pabloem
  4

• Add persistence of side inputs into state after they are calculated / executed

  #13 opened 2 years ago by pabloem
  2

• [batch] Create Pipeline State Manager

  #4 opened 2 years ago by pdames
  4

• [batch] Create Foundational CI/CD Workflows

  #5 opened 2 years ago by pdames
  1

• Parallelization: 'Reshuffle' data shared between stages

  #23 opened 2 years ago by pabloem
  2

• Refactor how we manage pcollections

  #34 opened 2 years ago by jjyao
  3

• A performance test for the Ray Beam portable runner

  #21 opened 2 years ago by pabloem
  3

• General questions on worker design

  #8 opened 2 years ago by wilsonwang371
  1

• Add support for timers in Portable Ray Runner

  #11 opened 2 years ago by pabloem
  1

• Add support for State in ParDo / DoFn operations

  #12 opened 2 years ago by pabloem
  0

• Support combiner lifting

  #16 opened 2 years ago by pabloem
  1

• Add formatting checks to CI to enforce a standard formatting

  #25 opened 2 years ago by pabloem
  2

• Support execution of Splittable DoFn without splitting

  #14 opened 2 years ago by pabloem
  2

• Start designing shuffling algorithm

  #26 opened 2 years ago by pabloem
  0

• [batch] Create Work Item Scheduler

  #3 opened 3 years ago by pdames
  1

• [batch] Create Python Ray Runner based on Beam Portability API

  #2 opened 3 years ago by pdames
  0