oap-project/remote-shuffle
Spark* shuffle plugin for support shuffling data through a remote Hadoop-compatible file system, as opposed to vanilla Spark's local-disks.
ScalaApache-2.0
Issues
- 0
- 0
OpenSSF issue
#75 opened by minmingzhu - 0
- 1
Enhance shuffle removing logic
#66 opened by jiafuzha - 0
RemoteUnsafeShuffleWriterSuite keep failing
#68 opened by zhaohc10 - 1
- 1
- 1
Adjust some default parameters for aurora env
#62 opened by jiafuzha - 0
Support akey offset size bigger than 2GB
#60 opened by jiafuzha - 0
- 1
Enable Serialized Shuffle in shuffle-daos
#39 opened by jiafuzha - 1
- 1
Make spark dependency provided
#53 opened by jiafuzha - 0
Update the documents for OAP 1.2.0
#40 opened by HongW2019 - 1
- 1
Support Spark-3.1 and Spark-3.2 in shuffle-daos
#50 opened by jiafuzha - 0
- 1
- 1
Enhance map-combine and map-ordering
#34 opened by jiafuzha - 0
Enhance executor memory release
#24 opened by jiafuzha - 1
Update version to 1.2.0
#35 opened by jiafuzha - 1
- 0
PerformanceEvaluationTool not in repository
#32 opened by trietopsoft - 0
Follow OAP name convention ${project.artifactId}-${project.version}-with-spark-${spark.version}
#28 opened by jiafuzha - 2
- 0
Follow OAP name convention
#26 opened by jiafuzha - 0
[Doc]Update the documents for OAP 1.1.1
#20 opened by HongW2019 - 1
Support DAOS Object Async API
#11 opened by jiafuzha - 0
upgrade to Spark-3.1.1
#18 opened by jiafuzha - 1
[Doc]Update the documentation for OAP 1.1.0
#15 opened by HongW2019 - 0
- 0
refactor shuffle-daos by abstracting shuffle IO for supporting both synchronous and asynchronous DAOS Object API
#6 opened by jiafuzha - 0
[SDLe][Snyk]Upgrade org.mock-server:mockserver-netty to fix vulnerability scanned by Snyk
#12 opened by HongW2019 - 0
- 0
- 0
Build documentation of different versions on website with Github Pages and Mkdocs
#2 opened by HongW2019