NVIDIA/spark-rapids

Release Checklist v24.10

caryr35 opened this issue · 0 comments

Release Checklist for v24.10:

Status Task Start End Owner
Pre-release
Notification to team of last feature sprint in milestone 2024-09-09 2024-09-27 @mattahrens
Burndown (no new features for current release) 2024-09-30 2024-10-11 Team
Update docs for current release in spark-rapids without updating release links 2024-10-07 2024-10-11 Team
Create a PR to update release links 2024-10-11 2024-10-11 @nvliyuan
Get RAPIDS 24.12 cudf java build working. 2024-09-23 2024-09-27 @NvTimLiu
Create 24.12 branch including spark-rapids-{jni,private} and spark-rapids 2024-09-26 2024-09-27 @NvTimLiu
Automerge from 24.10 to 24.12 2024-09-26 2024-09-27 @NvTimLiu
Enable Jenkins builds (premerge, nightly, integration, performance) for 24.12 2024-09-27 2024-10-01 @NvTimLiu
[spark-rapids-private 24.10] Java release to sonatype 2024-10-11 2024-10-11 @NvTimLiu
[spark-rapids-jni 24.10] Java release to sonatype 2024-10-11 2024-10-11 @NvTimLiu
[cudf 24.10] Java release to sonatype 2024-10-11 2024-10-11 @NvTimLiu
Notify RAPIDS team of javadocs for 24.10 2024-10-14 2024-10-14 @GaryShen2008
Staging release
Make 24.12 the default branch 2024-10-07 2024-10-07 @jlowe
Enable static scanning on the new 24.12 branches 2024-10-23 2024-10-23 @GaryShen2008
Merge all remaining branch-24.10 PRs 2024-10-11 2024-10-11 Team
Update spark-rapids-jni dependency version 2024-10-09 2024-10-09 @NvTimLiu
Create CHANGELOG.md 2024-10-11 2024-10-11 @NvTimLiu
Deliver Snapshot packages to QA 2024-10-07 2024-10-07 @NvTimLiu
Create a PR (not squashed) to merge from branch-24.10 to main. Needs review from repository owner 2024-10-11 2024-10-11 @NvTimLiu
Trigger the release for spark-rapids Jenkins job on the main branch and deploy the jar to sonatype staging (including spark-rapids-tools/core) 2024-10-15 2024-10-15 @NvTimLiu
Deliver final packages to QA 2024-10-15 2024-10-15 @NvTimLiu
Run integration tests on staging jars with AQE on, UCX on, Databricks Azure, Databricks AWS, Dataproc 2024-08-13 2024-08-16 @NvTimLiu
Run LHA tests on staging jars 2024-10-15 2024-10-18 @NvTimLiu
CDH testing(skip) 2024-10-15 2024-10-18 @NvTimLiu
QA testing with Snapshot on NGC V100,Colossus H100/A100/L4,Dataproc T4/L4, Databricks A10/T4. 2024-10-07 2024-10-17 @johnzhong
Run pre-processing workflow for DLRM sample use case(skip) 2024-10-15 2024-10-18 @johnzhong
QA testing with final packages on NGC V100,Colossus H100/A100/L4,Dataproc T4/L4, Databricks A10/T4. 2024-10-15 2024-10-18 @johnzhong
Release
Tag the release and deploy the staging artifacts to maven central repository 2024-10-23 2024-10-23 @NvTimLiu
Update gh-pages 2024-10-21 2024-10-23 @nvliyuan
Test spark-rapids-examples repo with Spark-Rapids 24.10 2024-10-21 2024-10-23 @nvliyuan
Update docs for current release in spark-rapids-examples 2024-10-21 2024-10-23 @nvliyuan
Update spark-rapids.sh in https://github.com/GoogleCloudDataproc/initialization-actions/tree/master/spark-rapids for the plugin 2024-10-21 2024-10-23 @nvliyuan