Tencent/Firestorm

Issues

• how to enter into uniffle wechat or dingtalk?

  #217 opened 2 years ago by qin7972
  0

• [Feature Request]Add a web UI in Coordinated Server to show the detailed server/job/metrics information

  #136 opened 2 years ago by jerryshao
  1

• To support more tasks with Firestorm

  #208 opened 2 years ago by colinmjj
  0

• Any plans to support run on K8S？

  #90 opened 3 years ago by fishcus
  5

• fault tolerance

  #198 opened 2 years ago by cpd85
  4

• hardcoded relative paths

  #146 opened 3 years ago by altaetran
  6

• Clear buffered data when acquiring memory failed and then retry

  #206 opened 3 years ago by zuston
  0

• Shuffle read does not read all data completely?

  #175 opened 3 years ago by xunxunmimi5577
  31

• Error with patch spark-3.1.2_dynamic_allocation_support.patch

  #106 opened 3 years ago by avs-alatau
  5

• Coordinator HA problem

  #194 opened 3 years ago by zuston
  6

• Unexpected crc value for blockId[474989042101783], expected:1518107711, actual:3331113690

  #166 opened 3 years ago by xunxunmimi5577
  5

• Support shuffle data replica?

  #181 opened 3 years ago by zuston
  5

• Compared to the native spark, the shuffle write data of firestorm is always smaller

  #157 opened 3 years ago by xunxunmimi5577
  2

• Whether local multiple replicas are supported？

  #149 opened 3 years ago by xunxunmimi5577
  2

• In local mode, why directory should be deleted first？

  #132 opened 3 years ago by xunxunmimi5577
  1

• [QUESTION] Executor在shuffle write/read 过程中是否落本地盘？

  #134 opened 3 years ago by fuhaiq
  2

• [QUESTION] 依赖Hadoop环境？

  #133 opened 3 years ago by fuhaiq
  3

• yarn-client模式下driver端进程一直不退出

  #128 opened 3 years ago by sfwang218
  9

• What‘s the difference between `spark.rss.storage.type` and `rss.storage.type`?

  #127 opened 3 years ago by xunxunmimi5577
  18

• 使用firestorm-0.4.0 运行spark3.1.1官方的JavaWordCount报如下错误，并且在yarn-client模式下driver端进程一直不退出

  #124 opened 3 years ago by sfwang218
  10

• Can promethues be used for monitoring ？

  #119 opened 3 years ago by xunxunmimi5577
  1

• duplicate servlets map in Coordinator Server

  #122 opened 3 years ago by dgzdot
  0

• Whether multiple disks are supported for local storage？

  #120 opened 3 years ago by xunxunmimi5577
  4

• What is the role of configuration "spark.rss.writer.buffer.segment.size"

  #114 opened 3 years ago by xunxunmimi5577
  4

• ShuffleServer died abnormally

  #112 opened 3 years ago by xunxunmimi5577
  2

• coordinator不需要是高可用的吗

  #109 opened 3 years ago by xunxunmimi5577
  4

• quorum write/read bug

  #105 opened 3 years ago by sfwang218
  5

• Errors in settings

  #103 opened 3 years ago by avs-alatau
  4

• Blocks read inconsistent

  #101 opened 3 years ago by shenghui361
  6

• The datasize of Shuffle read and write is much larger

  #100 opened 3 years ago by zuoliwei
  2

• Storage path must be set by the client or fetched from coordinators.

  #91 opened 3 years ago by zuoliwei
  4

• "Blocks read inconsistent" happened when shuffle read

  #76 opened 3 years ago by Augus-smile
  5

• Failed when Spark ESS is enabled

  #83 opened 3 years ago by Lobo2008
  4

• Not fast as expected

  #71 opened 3 years ago by Lobo2008
  2

• 请问出于什么考虑， coordinator没有使用常见的注册服务(zk, etcd, ...)?

  #70 opened 3 years ago by mggger
  1

• shuffle server OOM

  #49 opened 3 years ago by packageman
  5

• kill 1 rss which is being shuffle read/wirte, application will be re-run by yarn with new attempt id

  #48 opened 3 years ago by wangyi2021
  3

• Error happened when getShuffleAssignments with appId XXX to coordinator

  #42 opened 3 years ago by Lobo2008
  5

• shuffle write is too slow

  #35 opened 3 years ago by packageman
  4

• why not delete shuffle files when spark job finished?

  #20 opened 3 years ago by wangyi2021
  3

• Is AQE Suppurtted when spark use Firestorm?

  #19 opened 3 years ago by wangyi2021
  1

• spark.rss.storage.type 三种部署类型性能有差异吗？

  #17 opened 3 years ago by melin
  1

• [Feature] Add modifier and import checking to checkstyle

  #15 opened 3 years ago by duanmeng
  0

• [Feature] Read index file first in local mode

  #5 opened 3 years ago by duanmeng
  1

• Fix Dependabot alerts

  #13 opened 3 years ago by duanmeng
  1

• Add pull request template

  #9 opened 3 years ago by duanmeng
  1

• Create a first tag release for Firestorm

  #4 opened 3 years ago by jerryshao
  1

• Add license header to maven ci yaml file

  #1 opened 3 years ago by duanmeng
  0