amplab/succinct

Add support for bulk appends

anuragkh opened this issue · 1 comments

anuragkh commented

It would be nice to support bulk appends for SuccinctRDD and SuccinctKVRDD[K] as follows:

// For SuccinctRDD; the preservePartitioning flag dictates whether the 
// partitioning scheme for the data RDD should be preserved
def bulkAppend(data: RDD[Array[Byte]], preservePartitioning: Boolean = false)

// For SuccinctKVRDD
def bulkAppend[K](data: RDD[(K, Array[Byte]], preservePartitioning: Boolean = false)
anuragkh commented

Added in v0.1.6