uber/RemoteShuffleService

Issues

• Corrupted block detected during decompression

  #102 opened a year ago by YutingWang98
  0

• [Spark 3] RSS performance with Adaptive Skew Join Optimization

  #101 opened a year ago by s0nskar
  3

• Spark 3.1/3.2 failed sql skew and local reader tests

  #99 opened 2 years ago by YutingWang98
  2

• what may cause RssInvalidServerVersionException?

  #94 opened 2 years ago by Lobo2008
  2

• Does Rss support YARN executor preemption?

  #98 opened 2 years ago by YutingWang98
  0

• Does zeus only support jdk 11 +

  #95 opened 2 years ago by every-breaking-wave
  2

• Can Rss have stage retry when one server is down?

  #93 opened 2 years ago by YutingWang98
  13

• fault tolerance of restarting server

  #70 opened 2 years ago by cpd85
  7

• Rss shuffle data size is much larger than external shuffle service

  #90 opened 2 years ago by YutingWang98
  6

• How to evaluate rss cluster size?

  #92 opened 2 years ago by Lobo2008
  1

• Disk damage causes failure

  #89 opened 2 years ago by Lobo2008
  10

• Root directory not configurable via Helm chart

  #88 opened 2 years ago by nadenf
  0

• hit exception writing heading bytes XXXXX

  #76 opened 2 years ago by Lobo2008
  8

• Why this cannot support speculation

  #27 opened 4 years ago by boneanxs
  5

• How long the shuffle data of each ShuffleStage will be stored in RSS nodes?

  #81 opened 2 years ago by Lobo2008
  6

• Metrics in ScheduledMetricCollector

  #72 opened 2 years ago by Lobo2008
  0

• How to get metrics value from RSS?

  #32 opened 4 years ago by myandpr
  3

• Does RSS support multiple StreamServers on the same node?

  #71 opened 2 years ago by Lobo2008
  4

• write amplification

  #69 opened 3 years ago by cpd85
  2

• Shuffle Files Storage Is stored by default.Whether alluxio storage is supported and how to implement it.

  #68 opened 3 years ago by liangrui1988
  5

• spark 3.0

  #66 opened 3 years ago by avs-alatau
  4

• Using remote shuffle service with Spark operator

  #67 opened 3 years ago by roligupt
  2

• spark 3.1/3.2?

  #62 opened 3 years ago by cpd85
  10

• Unable to register with external shuffle server

  #64 opened 3 years ago by Lobo2008
  9

• Not support Storing data on HDFS and dynamicAllocation?

  #61 opened 3 years ago by Lobo2008
  1

• When to remove shuffle data in /tmp/StreamServer_* ？

  #65 opened 3 years ago by Lobo2008
  0

• which branch should be used for building jar and image for remote shuffle service for K8 environment?

  #63 opened 3 years ago by roligupt
  6

• Failed to get all RSS servers

  #60 opened 3 years ago by Lobo2008
  3

• [Proposal] Unsafe memory management in RSS mappers

  #59 opened 3 years ago by mayurdb
  0

• how to run on k8s

  #55 opened 3 years ago by hwk42
  0

• Why not use netty to create and manage client

  #58 opened 3 years ago by ipositive7
  0

• Whether to consider publishing the RemoteShuffleService jar to the Maven repository?

  #57 opened 3 years ago by wangyi2021
  0

• shuffle read error

  #54 opened 3 years ago by D3077
  5

• Does rss support hiveOnSpark?

  #56 opened 3 years ago by jinzhejz
  3

• It has error when using Spark 3.1 with RSS Spark-30 branch

  #34 opened 3 years ago by hbpeng0115
  2

• Compilation error caused by scala-maven-plugin

  #46 opened 3 years ago by Wilt-James
  1

• Reading control message may throw an exception in StreamServerMessageDecoder

  #48 opened 3 years ago by hzyfox
  1

• Compile error on Spark30 branch

  #31 opened 4 years ago by hbpeng0115
  1

• How to gracefully retention one RSS server?

  #30 opened 4 years ago by hbpeng0115
  3

• Unable to match RssShuffleHandle

  #29 opened 4 years ago by hbpeng0115
  3

• Unsupported shuffle manager

  #26 opened 4 years ago by danielhaviv
  2

• Zeus?

  #25 opened 4 years ago by choyrim
  2