Plan to support Spark 3.5?
camper42 opened this issue · 1 comments
camper42 commented
We're excited about some of the improvements in Spark 3.5, e.g.:
- Allow ShuffleDriverComponent to declare if shuffle data is reliably stored SPARK-42689
- Allow V2 writes to indicate advisory shuffle partition size SPARK-42779
Any plan on support Spark 3.5?
pan3793 commented
would like to find a time to complete it soon.