Improve performance of Spark-compatible decimal aggregates
Opened this issue · 1 comments
andygrove commented
What is the problem the feature request solves?
The benchmarks added in #948 show that Comet's Spark-compatible aggregates are ~50% slower than the DataFusion equivalents:
aggregate/avg_decimal_datafusion
time: [653.56 µs 657.57 µs 662.06 µs]
aggregate/avg_decimal_comet
time: [1.0581 ms 1.0592 ms 1.0604 ms]
aggregate/sum_decimal_datafusion
time: [695.51 µs 696.48 µs 697.60 µs]
aggregate/sum_decimal_comet
time: [1.0218 ms 1.0230 ms 1.0242 ms]
Describe the potential solution
No response
Additional context
No response
andygrove commented
Related upstream changes in arrow-rs: apache/arrow-rs#6419